summaryrefslogtreecommitdiffstats
path: root/include/framework
Commit message (Collapse)AuthorAgeFilesLines
* ProgressDouglas Rumbaugh2025-01-1711-345/+254
|
* Additional layout policies + more flexibility in buffer flushingDouglas Rumbaugh2025-01-165-29/+229
|
* More updatesDouglas B. Rumbaugh2024-12-223-6/+6
| | | | | | | BSM is currently broken--I'll need to think a bit about how best to actually implement this in the current framework (if I even want to port it over) because it doesn't use the same flushing mechanism as most other approaches.
* Continued developmentDouglas B. Rumbaugh2024-12-2210-121/+162
|
* Began overhauling reconstruction mechanismDouglas B. Rumbaugh2024-12-2210-707/+434
|
* Adjusted query result interfacesHEADmasterDouglas B. Rumbaugh2024-12-063-115/+92
| | | | | | | Now, the vector<> is part of the user-defined type, not required by the framework. This should allow for more flexibility in either using alternative containers, or for more sensible implementations of queries with single value results (like range count).
* Warning fixesDouglas B. Rumbaugh2024-12-062-5/+6
|
* Interface update (#5)Douglas B. Rumbaugh2024-12-0615-2369/+2440
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Query Interface Adjustments/Refactoring Began the process of adjusting the query interface (and also the shard interface, to a lesser degree) to better accommodate the user. In particular the following changes have been made, 1. The number of necessary template arguments for the query type has been drastically reduced, while also removing the void pointers and manual delete functions from the interface. This was accomplished by requiring many of the sub-types associated with a query (parameters, etc.) to be nested inside the main query class, and by forcing the SHARD type to expose its associated record type. 2. User-defined query return types are now supported. Queries no longer are required to return strictly sets of records. Instead, the query now has LocalResultType and ResultType template parameters (which can be defaulted using a typedef in the Query type itself), allowing much more flexibility. Note that, at least for the short term, the LocalResultType must still expose the same is_deleted/is_tombstone interface as a Wrapped<R> used to, as this is currently needed for delete filtering. A better approach to this is, hopefully, forthcoming. 3. Updated the ISAMTree.h shard and rangequery.h query to use the new interfaces, and adjusted the associated unit tests as well. 4. Dropped the unnecessary "get_data()" function from the ShardInterface concept. 5. Dropped the need to specify a record type in the ShardInterface concept. This is now handled using a required Shard::RECORD member of the Shard class itself, which should expose the name of the record type. * Updates to framework to support new Query/Shard interfaces Pretty extensive adjustments to the framework, particularly to the templates themselves, along with some type-renaming work, to support the new query and shard interfaces. Adjusted the external query interface to take an rvalue reference, rather than a pointer, to the query parameters. * Removed framework-level delete filtering This was causing some issues with the new query interface, and should probably be reworked anyway, so I'm temporarily (TM) removing the feature. * Updated benchmarks + remaining code for new interface
* MTree structure sizeDouglas Rumbaugh2024-05-101-1/+1
|
* Fixed arithmetic bugDouglas Rumbaugh2024-05-091-1/+1
|
* TSParmsweep: enabled forcing a full buffer scanDouglas Rumbaugh2024-05-081-1/+5
|
* Added a Bentley-Saxe layout policyDouglas Rumbaugh2024-05-014-8/+95
|
* Properly implemented support for iteratively decomposable problemsDouglas Rumbaugh2024-04-192-20/+26
|
* Removed debug print statementsDouglas Rumbaugh2024-04-192-4/+0
|
* Benchmark updatesDouglas Rumbaugh2024-04-192-1/+5
|
* Updated FSTrie to use const char * instead of std::stringDouglas Rumbaugh2024-04-151-0/+17
| | | | Note: this requires the caller to manage the memory of the strings
* Missed file from last commitDouglas Rumbaugh2024-04-151-1/+1
|
* Updates for build on OpenBSDDouglas B. Rumbaugh2024-03-252-1/+7
| | | | | | | | | Necessary updates to get the codebase building under OpenBSD 7.5 with clang. This is a minimal set of changes to get building to work, which includes disabling several things that aren't directly compatable. More work will be necessary to get full functionality. In particular, Triespline, PGM, and the reference M-tree do not currently build on OpenBSD with clang due to GNU dependencies or other gcc specific features.
* Record.h: Fixed wrapped record conceptDouglas Rumbaugh2024-03-221-3/+3
|
* MutableBuffer: added visibility flag to records and refactored timestampDouglas Rumbaugh2024-03-221-1/+5
|
* Record.h: Removed manual constructor and adjusted wrapped header fieldsDouglas Rumbaugh2024-03-221-10/+26
|
* Disabled lookahead for paper revisionDouglas Rumbaugh2024-03-221-1/+1
|
* Updates/progress towards succinct trie supportDouglas Rumbaugh2024-03-202-4/+13
|
* ExtensionStructure: first basic test of lookahead task stealingDouglas Rumbaugh2024-02-121-1/+10
|
* ExtensionStructure: Added simulated reconstruction lookaheadDouglas Rumbaugh2024-02-121-28/+88
| | | | | The reconstruction task procedure can now simulate future reconstructions to a specified depth.
* MutableBuffer: Allow hwm to equal lwmDouglas Rumbaugh2024-02-121-1/+1
| | | | | The high watermark and low watermark can now be equal, to allow for blocking reconstruction without requiring odd buffer sizes.
* Refactored Reconstruction TasksDouglas Rumbaugh2024-02-124-20/+10
| | | | | Added a ReconVector type to make it easier to do load balancing by shifting tasks around, and clean up a few interfaces.
* Added structure state vector w/ scratch version for reconstructionDouglas Rumbaugh2024-02-121-55/+89
| | | | | | | | | | | | | This approach should allow us to "simulate" a reconstruction to monitor the future state of the structure. The idea being that we can then add pre-emptive reconstructions to load balance and further smooth the tail latency curve. If a given reconstruction is significantly smaller than the next one will be, we can move some of the next one's work preemptively into the current one. The next phase is to do the simulation within the scratch_vector and then do a second pass examining the state of that reconstruction. In principle, we could look arbitrarily far ahead using this technique.
* Removed centralized version structureDouglas Rumbaugh2024-02-092-35/+8
|
* Framework: Fixed a bug where tagged deletes didn't release the epochDouglas Rumbaugh2024-02-091-2/+17
|
* Comment updates/fixesDouglas Rumbaugh2024-02-0911-67/+152
|
* Updated VPTree to new shard/query interfacesDouglas Rumbaugh2024-02-082-3/+19
|
* Fixed a slight synchronization bug in Epoch retirement "properly"Douglas Rumbaugh2024-02-081-10/+27
|
* Fully realized shard concept interfaceDouglas Rumbaugh2024-02-076-23/+16
|
* Fully implemented Query concept and adjusted queries to use itDouglas Rumbaugh2024-02-076-22/+17
|
* BufferView: Adjusted BV to avoid repeated modulus operationsDouglas Rumbaugh2024-02-052-15/+48
|
* Set up tombstone deletes properlyDouglas Rumbaugh2024-02-051-4/+10
|
* temporary hack to get workingDouglas Rumbaugh2024-01-311-6/+12
|
* Adjusted epoch transition methodologyDouglas Rumbaugh2024-01-313-152/+120
|
* More locking!Douglas Rumbaugh2024-01-311-0/+2
|
* Possibly fixed epoch retirement sync errorDouglas Rumbaugh2024-01-311-1/+5
|
* Insert throughput benchmarkDouglas Rumbaugh2024-01-311-1/+1
|
* Query/Insert intermix benchmarksDouglas Rumbaugh2024-01-311-3/+4
|
* Temporary thread affinity for reconstructionDouglas Rumbaugh2024-01-312-1/+33
|
* Benchmarking updatesDouglas Rumbaugh2024-01-301-6/+23
|
* DynamicExtension: Fixed reconstruction trigger data raceDouglas Rumbaugh2024-01-241-4/+7
| | | | | Tweak the reconstruction trigger code to ensure that multiple reconstructions won't be triggered at the same time.
* Adjusted recon_benchmark and properly shutdown FIFOSchedulerDouglas Rumbaugh2024-01-221-0/+1
|
* FIFOScheduler: added automake wakeupDouglas Rumbaugh2024-01-221-1/+12
| | | | | | | | | | | | Sometimes, when the max thread count is exceeded, it is possible for the scheduler to lock up. This is because the scheduler is only run when a new job is put into the queue, and so it is possible for a job to be blocked by thread limitations and be left sitting in the queue. If the main program is waiting on this job to finish before scheduling a new one, then the system deadlocks. I added a second background thread to the scheduler that wakes the scheduler up every 20us to resolve this and prevent these deadlocks.
* Initial rough-out of internal statistics trackerDouglas Rumbaugh2024-01-196-35/+157
| | | | | | Need to figure out the best way to do the detailed tracking in a concurrent manner. I was thinking just an event log, with parsing routines for extracting statistics. But that'll be pretty slow.
* Multiple concurrency bug fixesDouglas Rumbaugh2024-01-176-126/+107
| | | | | | | | A poorly organized commit with fixes for a variety of bugs that were causing missing records. The core problems all appear to be fixed, though there is an outstanding problem with tombstones not being completely canceled. A very small number are appearing in the wrong order during the static structure test.