summaryrefslogtreecommitdiffstats
path: root/include/framework
Commit message (Collapse)AuthorAgeFilesLines
* The scheduler now spawns a seperate merge threadDouglas Rumbaugh2023-09-184-58/+221
| | | | | | | | | | | Merges are now executed from a seperate thread within the scheduler that wakes up via condition variables when new merge tasks are scheduled. In addition, tombstone limits are now enforced by the scheduler, with new merges being scheduled as needed. There are still a few tests failing, notably the zero tombstones in the last run invarient is not holding under tiering with tombstones. Need to look into that yet.
* Moved individual merge task execution into the schedulerDouglas Rumbaugh2023-09-183-35/+98
| | | | | | | | | | | | | | | | | | | | This change is made in anticipation of scheduling each task using a specific thread, and required some modification to the interface of ExtensionStructure. Namely, 1. ExtensionStructure now supports a get_merge_tasks() interface, which returns a list of the individual level merges that would need to be performed to complete a buffer flush of specified size. 2. merge_levels and merge_buffer have been promoted to the public interface, to allow their use within the scheduler. 3. merge_buffer has been modified to assume that the structure already can support a direct flush of the buffer into L0, it is now the responsibility of the caller to ensure that the necessary merges have already been completed prior to calling this method. Currently, preemptive tombstone compactions are non-functional, so some unit tests are failing. This will be fixed when the thread scheduling system is set up.
* General bugfixesDouglas Rumbaugh2023-09-182-1/+5
|
* Began re-architecting the project for concurrency supportDouglas Rumbaugh2023-09-137-308/+645
| | | | | The project is now in a state where it builds, but it probably has a lot of bugs still.
* Migrated over to using psudb-common utilities/headersDouglas Rumbaugh2023-08-243-12/+12
|
* Expanded query interfaceDouglas Rumbaugh2023-07-272-8/+43
| | | | | Query interface now enables skipping of delete processing and stopping query processing when first match is found.
* Alex shard progressDouglas Rumbaugh2023-07-261-0/+7
|
* VPTree: fixed knn queryDouglas Rumbaugh2023-07-241-2/+8
|
* Cosine Similarity TypeDouglas Rumbaugh2023-07-241-4/+48
|
* Added the parameter argument to query merge routineDouglas Rumbaugh2023-07-171-1/+1
| | | | | This is necessary for KNN, but it unused for all currently implemented query types.
* PriorityQueue: generalized priority queue comparison operationDouglas Rumbaugh2023-07-171-0/+11
| | | | | Generalized the comparison used for the priority queue to enable its use within the KNN query code.
* VPTree: changed Point format to a D-dimensional point.Douglas Rumbaugh2023-07-171-6/+24
|
* VPTree: use a secondary hash-table for point lookupsDouglas Rumbaugh2023-07-171-0/+9
|
* Initial commit of VPTree-related codeDouglas Rumbaugh2023-07-131-11/+36
| | | | | | Point lookups are currently broken; I suspect that there is something wrong with tree construction, although the quickselect implementation seems to be fine.
* Fixed query errorsDouglas Rumbaugh2023-07-031-1/+1
|
* Fixed bug(s) in tagging-based deletesDouglas B. Rumbaugh2023-06-092-1/+2
|
* Build changes and interface cleanupDouglas B. Rumbaugh2023-06-092-6/+6
| | | | | | | | | | Renamed the get_record_cnt() functions to get_record_count() for consistency, dropped references to SSIs, and added openmp build flags for PGM related targets. Also adjusted dynamic_extension_tests.inc to fail when an erase fails during the static structure testing as part of debugging a delete cancellation problem under leveling.
* General header/file cleanupDouglas Rumbaugh2023-06-071-2/+0
|
* Interface adjustmentsDouglas Rumbaugh2023-06-072-33/+10
| | | | | | Layout and Delete Policies are now specified via template parameters, and rejection sampling has been removed as an argument to the mutable buffer constructor.
* Added a pre-query hook for processing statesDouglas Rumbaugh2023-06-071-1/+3
| | | | | This is used for setting up the query alias structure stuff for sampling queries.
* InternalLevel: bugfix when building under taggingDouglas Rumbaugh2023-06-071-1/+1
|
* Fixed uninitialized record header issueDouglas Rumbaugh2023-05-301-0/+1
|
* Framework query bugfixesDouglas Rumbaugh2023-05-291-1/+1
|
* Framework-level query testing + fixesDouglas Rumbaugh2023-05-291-9/+11
|
* WIRS Query tests + fixesDouglas Rumbaugh2023-05-291-0/+4
|
* Fixed InternalLevel memory leakDouglas Rumbaugh2023-05-292-41/+61
|
* Adjusted the way that Wrapping records works to clean up interfacesDouglas Rumbaugh2023-05-294-71/+58
|
* Tests and bugfixes for frameworkDouglas Rumbaugh2023-05-295-53/+62
|
* More updates/restructuringDouglas Rumbaugh2023-05-225-40/+180
|
* Progress towards generalization of shard interfaceDouglas Rumbaugh2023-05-225-486/+215
|
* Started implementing shard interface (not finished yet)Douglas Rumbaugh2023-05-173-34/+67
|
* Removed unncessary tagging paramter from shards and levelsDouglas Rumbaugh2023-05-172-30/+26
|
* Record format generalizationDouglas Rumbaugh2023-05-153-126/+101
| | | | | Currently, tombstone counting is bugged. But the rest of it appears to be working.
* Ported over IRS with unit testsDouglas Rumbaugh2023-05-091-1/+28
|
* Header updateDouglas Rumbaugh2023-05-091-0/+9
|
* Dynamic Extension unit tests + bugfixesDouglas Rumbaugh2023-05-092-87/+89
|
* MutableBuffer tests and bugfixesDouglas Rumbaugh2023-05-091-1/+1
|
* Initial port of DynamicExtension frameworkDouglas Rumbaugh2023-05-091-0/+633
|
* Initial port of InternalLevelDouglas Rumbaugh2023-05-092-0/+266
|
* Initial port of WIRS structure and mutable bufferDouglas Rumbaugh2023-05-091-0/+236