summaryrefslogtreecommitdiffstats
path: root/include/shard
Commit message (Collapse)AuthorAgeFilesLines
* Began migrating benchmarks over to new interfaceDouglas Rumbaugh2024-12-231-2/+2
|
* Continued developmentDouglas B. Rumbaugh2024-12-227-23/+23
|
* Interface update (#5)Douglas B. Rumbaugh2024-12-067-533/+213
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Query Interface Adjustments/Refactoring Began the process of adjusting the query interface (and also the shard interface, to a lesser degree) to better accommodate the user. In particular the following changes have been made, 1. The number of necessary template arguments for the query type has been drastically reduced, while also removing the void pointers and manual delete functions from the interface. This was accomplished by requiring many of the sub-types associated with a query (parameters, etc.) to be nested inside the main query class, and by forcing the SHARD type to expose its associated record type. 2. User-defined query return types are now supported. Queries no longer are required to return strictly sets of records. Instead, the query now has LocalResultType and ResultType template parameters (which can be defaulted using a typedef in the Query type itself), allowing much more flexibility. Note that, at least for the short term, the LocalResultType must still expose the same is_deleted/is_tombstone interface as a Wrapped<R> used to, as this is currently needed for delete filtering. A better approach to this is, hopefully, forthcoming. 3. Updated the ISAMTree.h shard and rangequery.h query to use the new interfaces, and adjusted the associated unit tests as well. 4. Dropped the unnecessary "get_data()" function from the ShardInterface concept. 5. Dropped the need to specify a record type in the ShardInterface concept. This is now handled using a required Shard::RECORD member of the Shard class itself, which should expose the name of the record type. * Updates to framework to support new Query/Shard interfaces Pretty extensive adjustments to the framework, particularly to the templates themselves, along with some type-renaming work, to support the new query and shard interfaces. Adjusted the external query interface to take an rvalue reference, rather than a pointer, to the query parameters. * Removed framework-level delete filtering This was causing some issues with the new query interface, and should probably be reworked anyway, so I'm temporarily (TM) removing the feature. * Updated benchmarks + remaining code for new interface
* Missing file from last commitDouglas Rumbaugh2024-05-061-2/+14
|
* TS+PGM: Inlined manually the sorted array merge for performance reasonsDouglas Rumbaugh2024-04-222-34/+248
|
* PGM Shard: Fully disabled bloom filterDouglas Rumbaugh2024-04-191-1/+0
|
* More trie baseline testsDouglas Rumbaugh2024-04-191-0/+199
|
* Benchmark updatesDouglas Rumbaugh2024-04-197-27/+17
|
* Updated FSTrie to use const char * instead of std::stringDouglas Rumbaugh2024-04-151-13/+5
| | | | Note: this requires the caller to manage the memory of the strings
* stuffDouglas Rumbaugh2024-04-111-1/+1
|
* Updated FSTrie benchmark and some minor fixesDouglas B. Rumbaugh2024-03-261-1/+1
|
* PointLookup: added a point lookup query for unique indexes, and some testsDouglas Rumbaugh2024-03-221-0/+6
|
* PGM.h: fixed an out of bounds array access on point lookup misses.Douglas Rumbaugh2024-03-221-3/+21
|
* FSTrie testing and debuggingDouglas Rumbaugh2024-03-221-101/+20
|
* Updates/progress towards succinct trie supportDouglas Rumbaugh2024-03-201-11/+28
|
* FST Shard w/ testsDouglas Rumbaugh2024-03-191-0/+266
| | | | | | | | | Needs some debugging--some methods currently fail within the library itself. The build system doesn't currently build the FST library. To compile, you'll first need to manually build it, and then place the libFST.so file in your LIBRARY_PATH and LD_LIBRARY_PATH.
* VPTree: precalculate distances to make construction more efficientDouglas B. Rumbaugh2024-02-211-19/+30
|
* Comment updates/fixesDouglas Rumbaugh2024-02-096-16/+29
|
* Updated VPTree to new shard/query interfacesDouglas Rumbaugh2024-02-081-232/+50
|
* Added compiler fence to block reorderingDouglas Rumbaugh2024-02-081-0/+6
| | | | I'm reasonably certain that this is a compiler bug...
* Cleaned up shard files (except VPTree)Douglas Rumbaugh2024-02-075-528/+171
| | | | | | Cleaned up shard implementations, fixed a few bugs, and set up some tests. There's still some work to be done in creating tests for the weighted sampling operations for the alias and aug btree shards.
* Fully realized shard concept interfaceDouglas Rumbaugh2024-02-073-12/+12
|
* TrieSpline + testsDouglas Rumbaugh2024-01-301-61/+90
|
* Multiple concurrency bug fixesDouglas Rumbaugh2024-01-171-15/+20
| | | | | | | | A poorly organized commit with fixes for a variety of bugs that were causing missing records. The core problems all appear to be fixed, though there is an outstanding problem with tombstones not being completely canceled. A very small number are appearing in the wrong order during the static structure test.
* Ported ISAMTree over to new buffer setupDouglas Rumbaugh2024-01-111-60/+65
| | | | | I may still play with the shard from shards constructor, and queries need some work yet too.
* Comment and License updatesDouglas Rumbaugh2023-11-076-6/+27
|
* Converted WIRS to the new interfaceDouglas Rumbaugh2023-11-071-287/+64
|
* Alias shard fixesDouglas Rumbaugh2023-11-071-2/+11
|
* Refactoring progressDouglas Rumbaugh2023-11-064-682/+31
|
* started refactoring queries interfaceDouglas B. Rumbaugh2023-11-021-361/+0
|
* MemISAM: updated to new query interfaceDouglas B. Rumbaugh2023-10-311-1/+1
|
* VPTree Shard: updates to build on my desktopDouglas B. Rumbaugh2023-10-311-0/+2
|
* General Comment + Consistency updatesDouglas Rumbaugh2023-10-306-6/+31
|
* Concurrency updates + fixes for compile errorsDouglas Rumbaugh2023-10-301-6/+8
|
* Re-structuring Project + scheduling updatesDouglas Rumbaugh2023-09-257-381/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a big one--probably should have split it apart, but I'm feeling lazy this morning. * Organized the mess of header files in include/framework by splitting them out into their own subdirectories, and renaming a few files to remove redundancies introduced by the directory structure. * Introduced a new framework/ShardRequirements.h header file for simpler shard development. This header simply contains the necessary includes from framework/* for creating shard files. This should help to remove structural dependencies from the framework file structure and shards, as well as centralizing the necessary framework files to make shard development easier. * Created a (currently dummy) SchedulerInterface, and make the scheduler implementation a template parameter of the dynamic extension for easier testing of various scheduling policies. There's still more work to be done to fully integrate the scheduler (queries, multiple buffers), but some more of the necessary framework code for this has been added as well. * Adjusted the Task interface setup for the scheduler. The task structures have been removed from ExtensionStructure and placed in their own header file. Additionally, I started experimenting with using std::variant, as opposed to inheritence, to implement subtype polymorphism on the Merge and Query tasks. The scheduler now has a general task queue that contains both, and std::variant, std::visit, and std::get are used to manipulate them without virtual functions. * Removed Alex.h, as it can't build anyway. There's a branch out there containing the Alex implementation stripped of the C++20 stuff. So there's no need to keep it here.
* Migrated over to using psudb-common utilities/headersDouglas Rumbaugh2023-08-247-17/+59
|
* Change PGM to range count.Dong Xie2023-07-282-32/+58
|
* Expanded query interfaceDouglas Rumbaugh2023-07-277-42/+226
| | | | | Query interface now enables skipping of delete processing and stopping query processing when first match is found.
* Alex shard progressDouglas Rumbaugh2023-07-261-0/+354
|
* Exposed epsilon configuration parameter for PGMDouglas Rumbaugh2023-07-261-4/+5
|
* Adjusted calculation for index sizeDouglas Rumbaugh2023-07-266-46/+53
|
* VPTree: account for size of pointer array in memory usageDouglas Rumbaugh2023-07-251-2/+1
|
* VPTree: Added template configuration to use/not use a hash tableDouglas Rumbaugh2023-07-251-6/+32
|
* VPTree: bugfixDouglas Rumbaugh2023-07-241-1/+1
|
* VPTree: added a level of indirection to avoid repeated point copiesDouglas Rumbaugh2023-07-241-23/+52
|
* VPTree: fixed knn queryDouglas Rumbaugh2023-07-241-50/+86
|
* VPTree: KNN query initial implementationDouglas Rumbaugh2023-07-241-4/+126
|
* ISAM IRS query bugfixesDouglas Rumbaugh2023-07-241-9/+28
|
* Triespline RQ fixesDouglas Rumbaugh2023-07-231-7/+26
|
* Benchmarking updatesDouglas Rumbaugh2023-07-231-2/+124
|