laa / orientdb Goto Github PK

The ODocumentDatatabase, etc. were deprecated a long time ago; their presence makes API bloated and confusing for users.

Files are removed quite rarely, so it is okay to keep a list of files with some gaps in this list for the removed files.
Also, files are either completely truncated or grown.
So, instead of a cache based on concurrent hash maps, it proposed having CAS-based array lists (that we already implemented).

Each file will have a separate list of page pointers that could be null or contain a pointer to the page itself.
In such a scheme, a cache with a database size of 1TB will require 1GB of heap space to manage, which is negligible overhead.

But as a result, we will have an almost instant fetch of the page from the cache upon request and do not need to create a key-object to fetch the page.

OrientDB uses a disk cache that represents the fork of the caffeine cache, which is changed to comply with our specific needs.
Caffeine introduced many changes to improve caffeine multicore scalability. We need to move those changes to our disk cache.

Offhand, I suspect the enhancements of interest are

Cache-line optimized frequency sketch. This was mostly for fun as it reduces from four random memory reads down to one, for a possible gain of 2.5x in my benchmark for a large sketch. That had a very modest user-facing difference.
Usage of hill climbing to adapt the window / main regions based on the workload
Usage of jitter to protect against hash flooding or an otherwise hot victim causing excessive rejections.
Improved handling an entry being updated to have a humungous weight that exceeds the region's capacity.
Caffeine does not implement the proposals from the size-aware TinyLFU paper, but that may be of interest for you to explore. It has been backlogged since it's less common / practical to bound by memory usage due to the GC, but may make more sense for a disk cache. A small change that concerned me in the paper was it switched from candidateFreq > victimFreq to >= which would negatively impact MRU loops. All of that would take a significant amount of time to validate and test so I punted on it, but their results looked very promising.
Caffeine does not implement the doorkeeper (bloom filter) optimization. That was originally because it increased the frequency bias which was a concern prior to hill climbing. Also a in-memory Java cache is probably not enormous so the space savings seemed less valuable. It is in the simulator but I never explored it deeply.
If you persist any of the LRU list then a common disk friendly alternative is the Clock policy to reduce I/O due to reordering. I don't think you do and I don't think it makes a lot of sense to persist that anyway, but fyi as it sometimes gets mentioned in papers.
Hope that helps somehow.

Add a created edge method to the schema that will create two things:

Creates property with the appropriate name in the schema and with the type of LINK_BAG.
Creates Edge class if such one does not exist.
A unique index is created if edge cardinality is restricted to 0..n.
If edge cardinality is restricted to 1..n, then no null requirement is added.
Related SQL commands also should be added.

Related documentation is also should be updated.

com.orientechnologies.orient.core.index.OIndexException: Index with name 'Person.firstName_lastName' cannot be created on class 'Person' because the field 'name' is absent in class definition
DB name="LuceneCreateIndexIntegrationTest"
com.orientechnologies.orient.core.index.OIndexException:
Index with name 'Person.firstName_lastName' cannot be created on class 'Person' because the field 'name' is absent in class definition
  DB name="LuceneCreateIndexIntegrationTest"
  at com.orientechnologies.orient.core.metadata.schema.OClassImpl.createIndex(OClassImpl.java:1034)
  at com.orientechnologies.lucene.integration.LuceneCreateIndexIntegrationTest.testCreateIndexJavaAPI(LuceneCreateIndexIntegrationTest.java:48)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:568)
  at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
  at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
  at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
  at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
  at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
  at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
  at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
  at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
  at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
  at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
  at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
  at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
  at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
  at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
  at org.junit.runners.Suite.runChild(Suite.java:128)
  at org.junit.runners.Suite.runChild(Suite.java:27)
  at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
  at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
  at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
  at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
  at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
  at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:49)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:120)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:95)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:69)
  at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:146)
  at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385)
  at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
  at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507)
  at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495)
------- Stderr: -------
2024-02-24 15:54:39:814 INFO Loading configuration from input stream [OServerConfigurationLoaderXml]
2024-02-24 15:54:40:171 INFO OrientDB Server v4.0.0-SNAPSHOT (build c1e86d5, branch develop) is starting up... [OServer]
2024-02-24 15:54:40:199 INFO Directory Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0 does not exist, try to create it. [OrientDBDistributed]
2024-02-24 15:54:40:202 INFO WAL maximum segment size is set to 6,144 MB [OrientDBDistributed]
2024-02-24 15:54:40:203 INFO [OVariableParser.resolveVariables] Property not found: ORIENTDB_HOME [OVariableParser]
2024-02-24 15:54:40:203 INFO Databases directory: Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0 [OServer]
2024-02-24 15:54:40:204 INFO Creating the system database 'OSystem' for current server [OSystemDatabase]
2024-02-24 15:54:40:206 INFO Page size for WAL located in Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\OSystem is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-02-24 15:54:40:212 INFO DWL:OSystem: block size = 512 bytes, maximum segment size = 3529 MB [DoubleWriteLogGL]
2024-02-24 15:54:41:132 INFO Listening binary connections on 0.0.0.0:2424 (protocol v.38, socket=default) [OServerNetworkListener]
2024-02-24 15:54:41:137 INFO OrientDB Studio available at http://localhost:2480/studio/index.html [OServer]
2024-02-24 15:54:41:138 INFO OrientDB Server is active v4.0.0-SNAPSHOT (build c1e86d5, branch develop). [OServer]
2024-02-24 15:54:41:235 INFO Page size for WAL located in Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-02-24 15:54:41:241 INFO DWL:LuceneCreateIndexIntegrationTest: block size = 512 bytes, maximum segment size = 3529 MB [DoubleWriteLogGL]
2024-02-24 15:54:43:487 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osequence_1556597019.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:489 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_7_96818582.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:490 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\internal_2018769306.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:492 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_33_1560090889.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:493 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_25_652688886.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:495 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\manindex_1491669731.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:541 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_2_1370613607.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:553 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_17_1402304101.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:564 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_2_798326827.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:584 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_7_1390442986.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:595 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_3_347495746.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:606 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_15_2008920310.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:607 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OFunction.name_597171868.hnb has been deleted. [AsyncFile]
2024-02-24 15:54:43:618 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ORole.name_893093591.nbt has been deleted. [AsyncFile]
2024-02-24 15:54:43:629 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_1_434465013.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:639 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_7_813298489.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:649 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_4_1159134445.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:659 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ouser_1858704983.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:669 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\config_1760392432.ccm has been deleted. [AsyncFile]
2024-02-24 15:54:43:679 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_0_198481117.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:690 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_4_1008025704.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:698 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\orole_584014647.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:705 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_27_1747324363.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:712 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_1_2116289568.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:719 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_5_440157860.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:726 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osecuritypolicy_2003417556.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:732 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_9_1679586131.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:739 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_6_55855270.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:746 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ofunction_489397451.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:753 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_33412627.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:760 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_13_118348296.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:767 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_6_104674590.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:774 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_4_941610795.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:781 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_7_903366364.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:787 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_31_1984664129.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:794 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_6_1268927457.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:800 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_2_820153951.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:807 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_1_203086165.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:814 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_2131129188.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:822 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_7_1720579407.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:828 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\index_1826880537.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:835 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_3_899087280.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:842 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\default_48748100.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:849 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ofunction_569989375.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:856 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_21_1110354073.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:862 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osecuritypolicy_311038256.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:872 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_4_1337712565.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:879 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_6_1571949691.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:886 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_1_126703738.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:893 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OUser.name_638474528.cbt has been deleted. [AsyncFile]
2024-02-24 15:54:43:900 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_12_1708479307.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:907 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_7_318120928.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:914 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OUser.name_1670006780.vpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:921 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\oschedule_873978952.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:927 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_2_554390999.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:43:934 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_842632294.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:941 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_1_183597613.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:948 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_5_570033534.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:954 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_6_1883111647.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:43:963 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osequence_712194547.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:43:973 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\config_368001479.bd has been deleted. [AsyncFile]
2024-02-24 15:54:43:983 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_5_303911740.grb has been deleted. [AsyncFile]
2024-02-24 15:54:43:992 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OFunction.name_828452155.him has been deleted. [AsyncFile]
2024-02-24 15:54:44:003 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_5_1135748121.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:013 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OFunction.name_959681182.hit has been deleted. [AsyncFile]
2024-02-24 15:54:44:024 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\orole_429538518.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:044 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_4_1374669533.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:051 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_2_629898926.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:057 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_3_1319897678.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:064 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_19_1090572438.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:071 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\index_273663865.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:078 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_1047671912.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:085 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_23_173273746.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:091 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OFunction.name_993418482.hib has been deleted. [AsyncFile]
2024-02-24 15:54:44:098 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_10_478728817.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:106 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_4_1291244007.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:115 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_3_390758453.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:126 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_3_1678846674.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:133 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\config_22859212.cd has been deleted. [AsyncFile]
2024-02-24 15:54:44:140 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\orole_680407965.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:146 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OUser.name_3240516.nbt has been deleted. [AsyncFile]
2024-02-24 15:54:44:153 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_6_734858383.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:161 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_5_357408302.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:168 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\default_407883746.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:174 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_234363011.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:181 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_2_995811582.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:188 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_6_519649762.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:194 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_3_1097868997.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:201 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_6_625172314.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:208 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_1_1394371865.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:214 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_24_1232775330.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:221 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_6_1361750944.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:228 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OSecurityPolicy.name_1808563448.cbt has been deleted. [AsyncFile]
2024-02-24 15:54:44:235 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ofunction_2043987764.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:242 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OSecurityPolicy.name_809643171.vpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:249 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_16_392589743.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:258 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_7_1318056534.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:268 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_1989523825.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:278 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_14_1272471478.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:288 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\internal_1049289872.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:298 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_30_257366068.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:308 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_5_221439229.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:317 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_28_292570850.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:328 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\manindex_1406301510.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:338 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ORole.name_1330490455.vpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:348 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ORole.name_223365628.cbt has been deleted. [AsyncFile]
2024-02-24 15:54:44:358 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_26_1754523514.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:367 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_4_1478392938.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:378 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_7_80003133.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:387 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_32_334829564.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:397 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_1_586699074.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:407 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ouser_319517460.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:418 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_3_433193227.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:435 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_5_230035801.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:447 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_8_876760158.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:458 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\oschedule_1586350721.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:468 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_1122007774.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:478 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_7_1871593379.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:489 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_20_299015604.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:500 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_3_350052033.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:512 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_5_373126057.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:519 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\internal_1675384245.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:526 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OFunction.name_1612827367.vpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:533 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_2_1048242942.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:539 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_11_2137165297.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:548 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_6_218605677.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:558 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_2_521903754.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:568 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_4_573791002.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:577 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\manindex_1057927230.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:587 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_7_1724810516.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:596 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\ouser_1233318489.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:605 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_29_760543467.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:615 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\config_1750246470.fcm has been deleted. [AsyncFile]
2024-02-24 15:54:44:625 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_3_1060791102.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:632 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_3_128297491.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:639 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_2_160955581.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:646 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_22_248018930.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:653 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_14400792.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:659 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\index_1590806576.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:666 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_1_829185421.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:673 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\OSecurityPolicy.name_1917302716.nbt has been deleted. [AsyncFile]
2024-02-24 15:54:44:680 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\config_2106510506.nd has been deleted. [AsyncFile]
2024-02-24 15:54:44:687 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_5_1206928270.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:694 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\default_194808718.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:701 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\oschedule_682113215.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:707 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\person_2_1043302292.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:714 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osecuritypolicy_358990828.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:721 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_4_1965523893.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:728 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_1215602954.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:734 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_4_1925076002.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:741 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\osequence_995831192.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:748 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_1_489237816.pcl has been deleted. [AsyncFile]
2024-02-24 15:54:44:755 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\v_1_111482663.fsm has been deleted. [AsyncFile]
2024-02-24 15:54:44:761 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\e_5_769176662.cpm has been deleted. [AsyncFile]
2024-02-24 15:54:44:768 INFO File Z:\buildAgent\work\f151d7f41c052276\lucene\target\server0\LuceneCreateIndexIntegrationTest\global_collection_18_1392844964.grb has been deleted. [AsyncFile]
2024-02-24 15:54:44:794 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] Dropped database 'LuceneCreateIndexIntegrationTest' [OConnectionBinaryExecutor]
2024-02-24 15:54:44:795 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] OrientDB Server is shutting down... [OServer]
2024-02-24 15:54:44:796 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] Shutting down listeners: [OServer]
2024-02-24 15:54:44:796 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] - ONetworkProtocolBinary /0.0.0.0:2424: [OServer]
2024-02-24 15:54:44:796 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] Shutting down protocols [OServer]
2024-02-24 15:54:44:800 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] Shutting down plugins: [OServerPluginManager]
2024-02-24 15:54:44:801 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] - shutdown storage: OSystem ... [OrientDBDistributed]
2024-02-24 15:54:44:955 INFO orientdb:LuceneCreateIndexIntegrationTest [LuceneCreateIndexIntegrationTest] OrientDB Server shutdown complete
[OServer]

com.orientechnologies.orient.enterprise.channel.binary.OTokenSecurityException: missing session and token
DB name="SelectProjectionVertexRemoteTest"
com.orientechnologies.orient.enterprise.channel.binary.OTokenSecurityException:
missing session and token
  DB name="SelectProjectionVertexRemoteTest"
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.onBeforeOperationalRequest(ONetworkProtocolBinary.java:537)
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:301)
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:238)
  at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:68)
------- Stderr: -------
2024-02-24 15:34:58:598 INFO Loading configuration from input stream [OServerConfigurationLoaderXml]
2024-02-24 15:34:58:619 INFO OrientDB Server v4.0.0-SNAPSHOT (build c1e86d5, branch develop) is starting up... [OServer]
2024-02-24 15:34:58:632 INFO WAL maximum segment size is set to 6,144 MB [OrientDBEmbedded]
2024-02-24 15:34:58:633 INFO [OVariableParser.resolveVariables] Property not found: ORIENTDB_HOME [OVariableParser]
2024-02-24 15:34:58:633 INFO Databases directory: Z:\buildAgent\work\f151d7f41c052276\graphdb\target\server [OServer]
2024-02-24 15:34:58:634 INFO Page size for WAL located in Z:\buildAgent\work\f151d7f41c052276\graphdb\target\server\OSystem is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-02-24 15:34:58:669 INFO DWL:OSystem: block size = 512 bytes, maximum segment size = 3551 MB [DoubleWriteLogGL]
2024-02-24 15:34:58:685 INFO orientdb:OSystem [OSystem] Storage 'plocal:Z:\buildAgent\work\f151d7f41c052276\graphdb\target\server/OSystem' is opened under OrientDB distribution : 4.0.0-SNAPSHOT (build c1e86d5, branch develop) [OLocalPaginatedStorage]
2024-02-24 15:34:58:701 INFO Listening binary connections on 0.0.0.0:3064 (protocol v.38, socket=default) [OServerNetworkListener]
2024-02-24 15:34:58:701 WARNI Authenticated clients can execute any kind of code into the server by using the following allowed languages: [sql] [OServerSideScriptInterpreter]
2024-02-24 15:34:58:701 INFO OrientDB Studio available at http://localhost:2480/studio/index.html [OServer]
2024-02-24 15:34:58:701 INFO OrientDB Server is active v4.0.0-SNAPSHOT (build c1e86d5, branch develop). [OServer]
2024-02-24 15:34:58:723 INFO orientdb:SelectProjectionVertexRemoteTest [SelectProjectionVertexRemoteTest] Storage 'memory:SelectProjectionVertexRemoteTest' is created under OrientDB distribution : 4.0.0-SNAPSHOT (build c1e86d5, branch develop) [ODirectMemoryStorage]
2024-02-24 15:34:58:932 WARNI Token signature failure: AAAAAARNQVBQAAAGAAAAAAAAAAAAAAGN2/LP/QAAJgAMb25ldF9zZXJfdjM3AAtKYXZhIENsaWVudABPNC4wLjAtU05BUFNIT1QgKGJ1aWxkIGMxZTg2ZDU3YmM2NzcyYzZmMmY3ZmE4YjkxM2IxYmM5NGZhMjAwNjAsIGJyYW5jaCBkZXZlbG9wKQ== [OTokenSignImpl]
2024-02-24 15:34:58:941 INFO OrientDB Server is shutting down... [OServer]
2024-02-24 15:34:58:941 INFO Shutting down listeners: [OServer]
2024-02-24 15:34:58:941 INFO - ONetworkProtocolBinary /0.0.0.0:3064: [OServer]
2024-02-24 15:34:58:941 INFO Shutting down protocols [OServer]
2024-02-24 15:34:58:956 INFO Shutting down plugins: [OServerPluginManager]
2024-02-24 15:34:58:956 INFO - script-interpreter [OServerPluginManager]
2024-02-24 15:34:58:957 INFO - shutdown storage: OSystem ... [OrientDBEmbedded]
2024-02-24 15:34:59:015 INFO - shutdown storage: SelectProjectionVertexRemoteTest ... [OrientDBEmbedded]
2024-02-24 15:34:59:016 INFO OrientDB Server shutdown complete
[OServer]

VarHandles are JVM backdoors for performance optimizations of serialization/deserialization operations that work with primitive datatypes on byte[]/ByteBuffer classes. We can very quickly, by changing a single class com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurablePage to improve the speed of database operations.

High-level algorithm https://ordinary-mine-bbc.notion.site/Implementation-of-the-serializable-level-of-isolation-in-the-OrientDB-algorithm-a29343931a3c430aa4985ac2ad893caa?pvs=4
Implementation details are coming.

Links:
Serializable Isolation for Snapshot Databases https://courses.cs.washington.edu/courses/cse444/08au/544M/READING-LIST/fekete-sigmod2008.pdf
The Serial Safety Net: Efficient Concurrency Control on Modern Hardware https://event.cwi.nl/damon2015/papers/damon15-wang.pdf
Efficiently making (almost) any concurrency control mechanism serializable https://arxiv.org/pdf/1605.04292.pdf
Efficient Black-box Checking of Snapshot Isolation in Databases https://www.vldb.org/pvldb/vol16/p1264-wei.pdf

Optionals are excellent polluters of JVM heap with garbage and should be avoided for better performance.

Those calls were used when we had no other means for serialization in a byte array. Right now, they are slower than the means provided by JDK.

Ensure durable creation and deletion of files in case of DDL operations. Neither of those operations should lead to data inconsistencies.

Currently, we use reader-writer counters to check which pages exclusively belong to the write cache. Once the memory limit is reached, these pages will be the first candidates to flush on the disk. Also, a reference counter is used to evict pages allocated in direct memory if there are no more references to the pages. They perform similar functions and can be replaced by a single reader-writer counter.

If we do not do that we have situation when index changes and document changes are decoupled by default that is dangerous situation.

Massive usage of thread locals leads to performance degradation. Those references are implemented not for free.
They access an instance of the current thread and then hash the map stored in the given thread instance.

The usage of thread locals also makes instance management harder to do.

The usage of JFR provides integration with different monitoring tools, including open telemetry.
Which is a de facto monitoring tool for the cloud.

Because lightweight edges have been prohibited since 4.0, we need to create a tool for users (likely SQL command, which will temporarily exist until the 5.0 version) to convert all lightweight edges into regular edges.

After implementing the given issue, we need to announce the deprivation of lightweight edges and describe converting them into larger ones.

VarHandles are JVM backdoors for performance optimizations of serialization/deserialization operations that work with primitive datatypes on byte[]/ByteBuffer classes. We can very quickly, by changing a single class com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurablePage to improve the speed of database operations.

Maven build configuration is currently a mess of hotfixes and needs to follow some must-have guidelines.
For example - correct plugin and dependency management.

OrientDB essentially gathers write set under four HashMaps:

  protected Map<ORID, ORID> updatedRids = new HashMap<ORID, ORID>();
  protected Map<ORID, ORecordOperation> allEntries = new LinkedHashMap<ORID, ORecordOperation>();
  protected Map<String, OTransactionIndexChanges> indexEntries =
      new LinkedHashMap<String, OTransactionIndexChanges>();
  protected Map<ORID, List<OTransactionRecordIndexOperation>> recordIndexOperations =
      new HashMap<ORID, List<OTransactionRecordIndexOperation>>();

It is proposed to store all of them in non-thread safe, non-durable B-Trees and clusters backed by MMAPed files in a temporary directory. That will allow us to handle write transactions of virtually infinite size.

Temporary directories will be removed on the transaction commit, rollback, and during DB start.

Data will be gathered in heap memory for in-memory databases, though.

Implement the shared instance of the write cache to ensure correct resource consumption in case of the presence of many databases inside the single JVM.

xxHash is faster, and its implementations provide a more user-friendly API.

org.junit.ComparisonFailure: expected:<[2]L> but was:<[1]L>
  at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
  at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:499)
  at com.orientechnologies.lucene.tests.OLuceneRangeTest.shouldUseRangeQueryMultipleFieldWithDirectIndexAccess(OLuceneRangeTest.java:239)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:568)
  at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
  at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
  at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
  at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
  at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
  at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
  at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
  at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
  at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
  at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
  at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
  at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
  at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
  at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
  at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
  at org.junit.runners.Suite.runChild(Suite.java:128)
  at org.junit.runners.Suite.runChild(Suite.java:27)
  at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
  at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
  at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
  at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
  at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
  at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
  at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
  at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:49)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:120)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:95)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
  at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:69)
  at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:146)
  at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385)
  at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
  at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507)
  at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495)
------- Stderr: -------
2024-02-19 22:03:59:752 INFO Storage 'memory:shouldUseRangeQueryMultipleFieldWithDirectIndexAccess' is created under OrientDB distribution : 4.0.0-SNAPSHOT (build 01c3524, branch develop) [ODirectMemoryStorage]

Implement Jepsen tests to ensure OreintDB ACID features in case of single-node deployment. The multi-node deployment validation will be implemented in a separate issue.

We already support disk async io, so to support virtual threads on a core level, we need to replace synchronized with ReentrantLock.

Create toJson, fromJson methods for ODatabaseConfiguraiton to use it both in OrientDB class and query processing.
That will allow not only to create databases along with users, using Java API but also pass database configuration there.

Add a method into the OrientDB class that creates a database alongside passed-in users and passwords so users of the embedded database will not suffer anymore.

Implement Wait-For graph deadlock detection and migration for component locking to page locking in TXs.
Use StampledLock implementation as a base for this new lock implementation to perform read queries on BTress and probably clusters without using memory barriers on X86 architecture.

Provide storage level seamless transparency for users' migration mechanics and implement migrations for deprecated data structures.
Provide a clear and understandable policy for our users that will explain our binary compatibility policy.

Right now, we need to make manual hacks to impose restrictions on such relations.
We need to add an API that will allow users to specify which restrictions they want to apply implicitly.

The database schema is a good candidate for such restrictions.

With the current architecture of handling transactions, we have everything that we need to make schema changes transactional. That is not done only because of historical reasons.

We need to revise the current approach and revise the way how we make changes.
Though such dramatic swift requires separate release.

Currently, implementation of such methods requires knowledge of the internals of OrientDB and so should be provided by API.

There is no need to deal with changes in transactions done to non-leaf classes of B-Tree index essential separators, which could be fake ones, and the presence of keys that we rolled back during transactions does not introduce any errors.

As a result, we can apply those changes directly to the pages and collect only the data needed to redo changes for a given transaction.

Only the last write that adds a key-value entry to the index page should be rolled back.

The results of query optimization using Roq query optimization look pretty promising. We should investigate to use as OrientDB query optimization approach https://arxiv.org/abs/2401.15210

Not-aligned data accesses dramatically decrease the speed of CPU operations, so:

Ensure that the addresses of all allocated pages are aligned by 4K (to ensure that we can use direct memory access if provided by JVM).
Ensure that all operations on all pages use addresses aligned by the size of their data units.
Create new versions of data structures in case of problems are found during the investigation and ensure binary compatibility. We already have the means inside storage to achieve such binary compatibility.

It seems like the test takes corner cases incorrectly.

Currently, every operation in storage requires the acquisition of a storage state lock that leads to a slowdown during the execution of queries. But we can avoid that by moving the execution of the query underneath the storage.
The idea is simple: we already have mechanics that allow us to replace storage instances for the current session in the database.

So before the execution of the query, we acquire state lock.
Then, we replace storage with the internal class with the same interface that provides access to storage methods without acquiring a state lock.

That is relatively quick to implement and will bring improvements in the speed of query execution.

Resolve all existing compiler warnings and fail build in case of the presence of new ones.

Such an approach will lead to zero copy overhead on reads and writes.
See https://blog.cloudflare.com/missing-manuals-io_uring-worker-pool/ , https://github.com/bbeaupain/nio_uring

Add methods that will check the existence of records with a given rid in the database.

Several data serializer implementations lack related unit tests. As a result, any change in them could lead to data corruption, which should be prevented.

JavaCC gramar and independence:

1. Increases resource consumption.
2. Is a nightmare from support point of view.

See https://github.com/sirthias/parboiled

To ensure visibility and correctness of TX handling, we need to:

1. Clear record cache before TX.
2. Clear record cache after TX.
3. Unload all records with hard references after TX completion.

All operations on the database inside its engine do not need to know the meaning of the data they operate.

They only need to know two things:

Whether two pieces of data are equal.
Which piece of data is semantically bigger than the other?
All our data except strings in such cases can be represented as raw byte arrays that can noticeably increase data processing.
As for strings, we can use the IBM ICU library to implement normalized versions of strings in the form of byte arrays.

1. Separate public API using the Java module system.
2. Provide comprehensive JavaDoc documentation for the provided public API.
3. Remove deprecated methods.
4. Deprecate methods that are not considered correct to use but were not deprecated for some reason.

Currently, we use the WOW cache algorithm for caching writes before flushing on disk. This algorithm looks outdated, and there are already more modern approaches. STOW cache looks quite promising in this area.

https://www.usenix.org/legacy/event/usenix09/tech/slides/gill.pdf
https://www.usenix.org/conference/usenix-09/stow-spatially-and-temporally-optimized-write-caching-algorithm
https://www.usenix.org/legacy/event/usenix09/tech/full_papers/gill/gill.pdf

OrientDB Lucene integration uses MMAP, forcing both OrientDB and Lucene to compete for the shared RAM, which may cause performance degradation in the case of intensive usage of different types of indexes.

Implementation of sequences is highly unstable and leads to situations when tests constantly fail.
We need to implement it; in the current state, sequence implementation is merely unusable.