summaryrefslogtreecommitdiffstats
path: root/include
Commit message (Collapse)AuthorAgeFilesLines
* ExtensionStructure: first basic test of lookahead task stealingDouglas Rumbaugh2024-02-122-1/+14
|
* ExtensionStructure: Added simulated reconstruction lookaheadDouglas Rumbaugh2024-02-121-28/+88
| | | | | The reconstruction task procedure can now simulate future reconstructions to a specified depth.
* MutableBuffer: Allow hwm to equal lwmDouglas Rumbaugh2024-02-121-1/+1
| | | | | The high watermark and low watermark can now be equal, to allow for blocking reconstruction without requiring odd buffer sizes.
* Refactored Reconstruction TasksDouglas Rumbaugh2024-02-125-20/+77
| | | | | Added a ReconVector type to make it easier to do load balancing by shifting tasks around, and clean up a few interfaces.
* Added structure state vector w/ scratch version for reconstructionDouglas Rumbaugh2024-02-121-55/+89
| | | | | | | | | | | | | This approach should allow us to "simulate" a reconstruction to monitor the future state of the structure. The idea being that we can then add pre-emptive reconstructions to load balance and further smooth the tail latency curve. If a given reconstruction is significantly smaller than the next one will be, we can move some of the next one's work preemptively into the current one. The next phase is to do the simulation within the scratch_vector and then do a second pass examining the state of that reconstruction. In principle, we could look arbitrarily far ahead using this technique.
* Removed centralized version structureDouglas Rumbaugh2024-02-092-35/+8
|
* Framework: Fixed a bug where tagged deletes didn't release the epochDouglas Rumbaugh2024-02-091-2/+17
|
* Comment updates/fixesDouglas Rumbaugh2024-02-0923-103/+223
|
* Updated VPTree to new shard/query interfacesDouglas Rumbaugh2024-02-084-235/+228
|
* Added compiler fence to block reorderingDouglas Rumbaugh2024-02-081-0/+6
| | | | I'm reasonably certain that this is a compiler bug...
* Fixed a slight synchronization bug in Epoch retirement "properly"Douglas Rumbaugh2024-02-081-10/+27
|
* Cleaned up shard files (except VPTree)Douglas Rumbaugh2024-02-077-529/+357
| | | | | | Cleaned up shard implementations, fixed a few bugs, and set up some tests. There's still some work to be done in creating tests for the weighted sampling operations for the alias and aug btree shards.
* Fully realized shard concept interfaceDouglas Rumbaugh2024-02-0714-40/+33
|
* Fully implemented Query concept and adjusted queries to use itDouglas Rumbaugh2024-02-0711-52/+44
|
* BufferView: Adjusted BV to avoid repeated modulus operationsDouglas Rumbaugh2024-02-052-15/+48
|
* Set up tombstone deletes properlyDouglas Rumbaugh2024-02-054-26/+32
|
* temporary hack to get workingDouglas Rumbaugh2024-01-311-6/+12
|
* Adjusted epoch transition methodologyDouglas Rumbaugh2024-01-313-152/+120
|
* More locking!Douglas Rumbaugh2024-01-311-0/+2
|
* Updated insert query throughput to use IRS queriesDouglas Rumbaugh2024-01-311-7/+11
|
* Possibly fixed epoch retirement sync errorDouglas Rumbaugh2024-01-311-1/+5
|
* Insert throughput benchmarkDouglas Rumbaugh2024-01-311-1/+1
|
* Query/Insert intermix benchmarksDouglas Rumbaugh2024-01-311-3/+4
|
* Temporary thread affinity for reconstructionDouglas Rumbaugh2024-01-312-1/+33
|
* TrieSpline + testsDouglas Rumbaugh2024-01-301-61/+90
|
* Benchmarking updatesDouglas Rumbaugh2024-01-301-6/+23
|
* DynamicExtension: Fixed reconstruction trigger data raceDouglas Rumbaugh2024-01-241-4/+7
| | | | | Tweak the reconstruction trigger code to ensure that multiple reconstructions won't be triggered at the same time.
* Adjusted recon_benchmark and properly shutdown FIFOSchedulerDouglas Rumbaugh2024-01-221-0/+1
|
* FIFOScheduler: added automake wakeupDouglas Rumbaugh2024-01-221-1/+12
| | | | | | | | | | | | Sometimes, when the max thread count is exceeded, it is possible for the scheduler to lock up. This is because the scheduler is only run when a new job is put into the queue, and so it is possible for a job to be blocked by thread limitations and be left sitting in the queue. If the main program is waiting on this job to finish before scheduling a new one, then the system deadlocks. I added a second background thread to the scheduler that wakes the scheduler up every 20us to resolve this and prevent these deadlocks.
* Added RangeCount queryDouglas Rumbaugh2024-01-221-0/+169
|
* Initial rough-out of internal statistics trackerDouglas Rumbaugh2024-01-196-35/+157
| | | | | | Need to figure out the best way to do the detailed tracking in a concurrent manner. I was thinking just an event log, with parsing routines for extracting statistics. But that'll be pretty slow.
* Multiple concurrency bug fixesDouglas Rumbaugh2024-01-178-143/+130
| | | | | | | | A poorly organized commit with fixes for a variety of bugs that were causing missing records. The core problems all appear to be fixed, though there is an outstanding problem with tombstones not being completely canceled. A very small number are appearing in the wrong order during the static structure test.
* Concurrency testing and bug fixesDouglas B. Rumbaugh2024-01-152-7/+24
|
* Use 16-byte CAS to control buffer headDouglas B. Rumbaugh2024-01-151-61/+59
|
* Various single-threaded bug fixesDouglas B. Rumbaugh2024-01-154-15/+55
|
* Initial integration of new buffering scheme into frameworkDouglas Rumbaugh2024-01-128-277/+142
| | | | | It isn't working right now (lotsa test failures), but we're to the debugging phase now.
* BufferView.h: Hopefully the last necessary tweak to the move semantics stuffDouglas Rumbaugh2024-01-121-24/+2
| | | | | | | | You can't move assign an std::Bind, but you can move construct it. So I had to disable the move assignment operator. This means that when you change the BufferView ownership over to, say, a QueryBufferState object, you need to do it by passing std::move(buffview) into a constructor call only--you cannot assign it.
* InternalLevel update and testsDouglas Rumbaugh2024-01-112-16/+39
| | | | | Plus some assorted fixes for move semantics stuff in BufferView that accompanied these changes.
* Ported ISAMTree over to new buffer setupDouglas Rumbaugh2024-01-111-60/+65
| | | | | I may still play with the shard from shards constructor, and queries need some work yet too.
* BufferView: enforce move semanticsDouglas Rumbaugh2024-01-111-2/+19
| | | | | | Because a BufferView's lifetime is so tightly linked to the lifetime of regions of the buffer, it can't be copied without potentially breaking things.
* Fixed some potential buffer-related concurrency bugsDouglas Rumbaugh2024-01-112-57/+94
|
* MutableBuffer: multithreaded insert test + bugfixesDouglas Rumbaugh2024-01-101-4/+9
|
* MutableBuffer+View: Implementation with unit testsDouglas Rumbaugh2024-01-102-49/+116
|
* Initial update of buffer to new specificationsDouglas B. Rumbaugh2024-01-092-152/+62
| | | | | | | | | | | | | | | | | | | There are a few minor issues that this introduces, however. Global tracking of a lot of secondary information, such as weights for WIRS/WSS, or the exact number of tombstones will need to be approached differently than they have been historically with this new approach. I've also removed most of the tombstone capacity related code. We had decided not to bother enforcing this at the buffer level anyway, and it would greatly increase the complexity of the problem of predicting when the next compaction will be. On the whole this new approach seems like it'll simplify a lot. This commit actually removes significantly more code than it adds. One minor issue: the currently implementation will have problems in the circular array indexes once more than 2^64 records have been inserted. This doesn't seem like a realistic problem at the moment.
* DynamicExtension: comments/reorganizationDouglas Rumbaugh2023-12-211-7/+19
| | | | | Clarified the reasoning for a few things in comments that just tripped me up during debugging.
* InternalLevel: appending an empty level is a no-opDouglas Rumbaugh2023-12-211-0/+7
| | | | | | | | The existing reconstruction logic will occasionally attempt to append an empty level to another empty level, for some reason. While the underlying cause of this needs to be looked into, this special case should prevent shard constructors being called with a shard count of 0 under tiering, reducing the error handling overhead of shard code.
* ExtensionStructure: adjusted leveling logic to avoid unneeded copiesDouglas Rumbaugh2023-12-211-5/+14
| | | | | | | | This also reduces the special-case overhead on shards. As it was, shards would need to handle a special case when constructing from other shards where the first of the two provided shards was a nullptr, which caused a number of subtle issues (or outright crashes in some cases) with existing shard implementations.
* Refactoring: corrected a number of names and added more commentsDouglas Rumbaugh2023-12-137-140/+163
|
* Lock protect Epoch during retirement to avoid use-after-free errorsDouglas Rumbaugh2023-11-151-11/+16
|
* Tombstone Compaction: re-enabled tombstone compactionDouglas Rumbaugh2023-11-134-3/+106
| | | | | | | Currently, proactive buffer tombstone compaction is disabled by forcing the buffer tombstone capacity to match its record capacity. It isn't clear how to best handle proactive buffer compactions in an environment where new buffers are spawned anyway.