summaryrefslogtreecommitdiffstats
path: root/include/framework/structure/ExtensionStructure.h
Commit message (Collapse)AuthorAgeFilesLines
* Code reformattingDouglas Rumbaugh2025-09-251-62/+77
|
* Beginnings of per-level cost modelingDouglas Rumbaugh2025-09-171-0/+15
| | | | | | | | | | | | The total time required for each shard construction is now measured, and hooks have been added to InternalLevel to support the creation and use of per-level cost models. The appropriate calls to these functions are now made during reconstruction, but the scheduling process doesn't yet call them, nor are the models actually implemented.
* Implemented the legacy policies and fixed a few bugsDouglas Rumbaugh2025-04-071-3/+18
|
* working commit (temporary progress, doesn't build)Douglas Rumbaugh2025-04-051-0/+3
|
* progress towards resolving asynch structure mergesDouglas Rumbaugh2025-02-131-81/+51
|
* Progress: began adding parallel merging and locking of levelsDouglas Rumbaugh2025-02-111-4/+15
|
* Background compaction stuffDouglas Rumbaugh2025-02-061-10/+62
|
* More updatesDouglas Rumbaugh2025-01-311-2/+4
|
* progressDouglas Rumbaugh2025-01-271-7/+1
|
* some progressDouglas Rumbaugh2025-01-241-70/+10
|
* ProgressDouglas Rumbaugh2025-01-171-11/+10
|
* Additional layout policies + more flexibility in buffer flushingDouglas Rumbaugh2025-01-161-29/+66
|
* Continued developmentDouglas B. Rumbaugh2024-12-221-14/+49
|
* Began overhauling reconstruction mechanismDouglas B. Rumbaugh2024-12-221-496/+65
|
* Warning fixesDouglas B. Rumbaugh2024-12-061-4/+5
|
* Interface update (#5)Douglas B. Rumbaugh2024-12-061-521/+559
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Query Interface Adjustments/Refactoring Began the process of adjusting the query interface (and also the shard interface, to a lesser degree) to better accommodate the user. In particular the following changes have been made, 1. The number of necessary template arguments for the query type has been drastically reduced, while also removing the void pointers and manual delete functions from the interface. This was accomplished by requiring many of the sub-types associated with a query (parameters, etc.) to be nested inside the main query class, and by forcing the SHARD type to expose its associated record type. 2. User-defined query return types are now supported. Queries no longer are required to return strictly sets of records. Instead, the query now has LocalResultType and ResultType template parameters (which can be defaulted using a typedef in the Query type itself), allowing much more flexibility. Note that, at least for the short term, the LocalResultType must still expose the same is_deleted/is_tombstone interface as a Wrapped<R> used to, as this is currently needed for delete filtering. A better approach to this is, hopefully, forthcoming. 3. Updated the ISAMTree.h shard and rangequery.h query to use the new interfaces, and adjusted the associated unit tests as well. 4. Dropped the unnecessary "get_data()" function from the ShardInterface concept. 5. Dropped the need to specify a record type in the ShardInterface concept. This is now handled using a required Shard::RECORD member of the Shard class itself, which should expose the name of the record type. * Updates to framework to support new Query/Shard interfaces Pretty extensive adjustments to the framework, particularly to the templates themselves, along with some type-renaming work, to support the new query and shard interfaces. Adjusted the external query interface to take an rvalue reference, rather than a pointer, to the query parameters. * Removed framework-level delete filtering This was causing some issues with the new query interface, and should probably be reworked anyway, so I'm temporarily (TM) removing the feature. * Updated benchmarks + remaining code for new interface
* Added a Bentley-Saxe layout policyDouglas Rumbaugh2024-05-011-4/+56
|
* Removed debug print statementsDouglas Rumbaugh2024-04-191-2/+0
|
* Benchmark updatesDouglas Rumbaugh2024-04-191-0/+2
|
* Disabled lookahead for paper revisionDouglas Rumbaugh2024-03-221-1/+1
|
* ExtensionStructure: first basic test of lookahead task stealingDouglas Rumbaugh2024-02-121-1/+10
|
* ExtensionStructure: Added simulated reconstruction lookaheadDouglas Rumbaugh2024-02-121-28/+88
| | | | | The reconstruction task procedure can now simulate future reconstructions to a specified depth.
* Refactored Reconstruction TasksDouglas Rumbaugh2024-02-121-15/+8
| | | | | Added a ReconVector type to make it easier to do load balancing by shifting tasks around, and clean up a few interfaces.
* Added structure state vector w/ scratch version for reconstructionDouglas Rumbaugh2024-02-121-55/+89
| | | | | | | | | | | | | This approach should allow us to "simulate" a reconstruction to monitor the future state of the structure. The idea being that we can then add pre-emptive reconstructions to load balance and further smooth the tail latency curve. If a given reconstruction is significantly smaller than the next one will be, we can move some of the next one's work preemptively into the current one. The next phase is to do the simulation within the scratch_vector and then do a second pass examining the state of that reconstruction. In principle, we could look arbitrarily far ahead using this technique.
* Comment updates/fixesDouglas Rumbaugh2024-02-091-29/+35
|
* Fully realized shard concept interfaceDouglas Rumbaugh2024-02-071-1/+1
|
* Fully implemented Query concept and adjusted queries to use itDouglas Rumbaugh2024-02-071-1/+1
|
* Initial integration of new buffering scheme into frameworkDouglas Rumbaugh2024-01-121-29/+12
| | | | | It isn't working right now (lotsa test failures), but we're to the debugging phase now.
* ExtensionStructure: adjusted leveling logic to avoid unneeded copiesDouglas Rumbaugh2023-12-211-5/+14
| | | | | | | | This also reduces the special-case overhead on shards. As it was, shards would need to handle a special case when constructing from other shards where the first of the two provided shards was a nullptr, which caused a number of subtle issues (or outright crashes in some cases) with existing shard implementations.
* Refactoring: corrected a number of names and added more commentsDouglas Rumbaugh2023-12-131-75/+67
|
* Tombstone Compaction: re-enabled tombstone compactionDouglas Rumbaugh2023-11-131-0/+51
| | | | | | | Currently, proactive buffer tombstone compaction is disabled by forcing the buffer tombstone capacity to match its record capacity. It isn't clear how to best handle proactive buffer compactions in an environment where new buffers are spawned anyway.
* Comment and License updatesDouglas Rumbaugh2023-11-071-1/+1
|
* Fixes for various bugs under SerialSchedulerDouglas B. Rumbaugh2023-10-311-1/+4
|
* MutableBuffer: removed most concurrency control stuffDouglas B. Rumbaugh2023-10-311-3/+3
| | | | | | The buffer isn't responsible for a lot of CC anymore (just the append operation), so this code was no longer necessary. Also removed the only calls to some of these CC operations within the rest of the framework.
* ExtensionStructure: fixed incorrect constructor args in clone()Douglas B. Rumbaugh2023-10-311-2/+2
|
* General Comment + Consistency updatesDouglas Rumbaugh2023-10-301-2/+2
|
* Began moving to an explicit epoch-based systemDouglas Rumbaugh2023-10-231-0/+26
| | | | | | | I started moving over to an explicit Epoch based system, which has necessitated a ton of changes throughout the code base. This will ultimately allow for a much cleaner set of abstractions for managing concurrency.
* Initial pass w/ new scheduler setupDouglas Rumbaugh2023-10-201-12/+9
| | | | currently there's a race condition of some type to sort out.
* Re-structuring Project + scheduling updatesDouglas Rumbaugh2023-09-251-0/+428
This is a big one--probably should have split it apart, but I'm feeling lazy this morning. * Organized the mess of header files in include/framework by splitting them out into their own subdirectories, and renaming a few files to remove redundancies introduced by the directory structure. * Introduced a new framework/ShardRequirements.h header file for simpler shard development. This header simply contains the necessary includes from framework/* for creating shard files. This should help to remove structural dependencies from the framework file structure and shards, as well as centralizing the necessary framework files to make shard development easier. * Created a (currently dummy) SchedulerInterface, and make the scheduler implementation a template parameter of the dynamic extension for easier testing of various scheduling policies. There's still more work to be done to fully integrate the scheduler (queries, multiple buffers), but some more of the necessary framework code for this has been added as well. * Adjusted the Task interface setup for the scheduler. The task structures have been removed from ExtensionStructure and placed in their own header file. Additionally, I started experimenting with using std::variant, as opposed to inheritence, to implement subtype polymorphism on the Merge and Query tasks. The scheduler now has a general task queue that contains both, and std::variant, std::visit, and std::get are used to manipulate them without virtual functions. * Removed Alex.h, as it can't build anyway. There's a branch out there containing the Alex implementation stripped of the C++20 stuff. So there's no need to keep it here.