Skip to content

Commit 2560371

Browse files
committed
2 parents b4caa4d + efdcd4b commit 2560371

1 file changed

Lines changed: 118 additions & 72 deletions

File tree

performance.md

Lines changed: 118 additions & 72 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
# VFBquery Performance Test Results
22

3-
**Test Date:** 2026-02-02 04:17:08 UTC
4-
**Git Commit:** 149ffe79fba63cfa149929f34dbd46fd54136621
3+
**Test Date:** 2026-02-04 04:26:45 UTC
4+
**Git Commit:** 6bc4d6ca382711555b357a9dff702dc182fffb6b
55
**Branch:** main
6-
**Workflow Run:** [21577138574](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/21577138574)
6+
**Workflow Run:** [21658000888](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/21658000888)
77

88
## Test Overview
99

@@ -91,7 +91,7 @@ Test neuron part overlap queries ... ok
9191
test_03_synaptic_queries (src.test.test_query_performance.QueryPerformanceTest)
9292
Test synaptic terminal queries ... ok
9393
test_04_anatomy_hierarchy_queries (src.test.test_query_performance.QueryPerformanceTest)
94-
Test anatomical hierarchy queries ... ok
94+
Test anatomical hierarchy queries ... FAIL
9595
test_05_tract_lineage_queries (src.test.test_query_performance.QueryPerformanceTest)
9696
Test tract/nerve and lineage clone queries ... ok
9797
test_05b_image_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -103,22 +103,85 @@ Test neuron connectivity queries ... ok
103103
test_08_similarity_queries (src.test.test_query_performance.QueryPerformanceTest)
104104
Test NBLAST similarity queries ... ok
105105
test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
106-
Test neuron input/synapse queries ... ok
106+
Test neuron input/synapse queries ... FAIL
107107
test_10_expression_queries (src.test.test_query_performance.QueryPerformanceTest)
108-
Test expression pattern queries ... ok
108+
Test expression pattern queries ... FAIL
109109
test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
110-
Test scRNAseq transcriptomics queries ... ok
110+
Test scRNAseq transcriptomics queries ... FAIL
111111
test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
112-
Test NBLAST similarity queries ... ok
112+
Test NBLAST similarity queries ... FAIL
113113
test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
114-
Test dataset and template queries ... ok
114+
Test dataset and template queries ... FAIL
115115
test_14_publication_transgene_queries (src.test.test_query_performance.QueryPerformanceTest)
116-
Test publication and transgene queries ... ok
116+
Test publication and transgene queries ... FAIL
117117
118+
======================================================================
119+
FAIL: test_04_anatomy_hierarchy_queries (src.test.test_query_performance.QueryPerformanceTest)
120+
Test anatomical hierarchy queries
121+
----------------------------------------------------------------------
122+
Traceback (most recent call last):
123+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 206, in test_04_anatomy_hierarchy_queries
124+
self.assertLess(duration, self.THRESHOLD_SLOW, "ComponentsOf exceeded threshold")
125+
AssertionError: 15.446540832519531 not less than 15.0 : ComponentsOf exceeded threshold
126+
127+
======================================================================
128+
FAIL: test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
129+
Test neuron input/synapse queries
130+
----------------------------------------------------------------------
131+
Traceback (most recent call last):
132+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 386, in test_09_neuron_input_queries
133+
self.assertLess(duration, self.THRESHOLD_SLOW, "NeuronInputsTo exceeded threshold")
134+
AssertionError: 405.9274363517761 not less than 15.0 : NeuronInputsTo exceeded threshold
135+
136+
======================================================================
137+
FAIL: test_10_expression_queries (src.test.test_query_performance.QueryPerformanceTest)
138+
Test expression pattern queries
139+
----------------------------------------------------------------------
140+
Traceback (most recent call last):
141+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 405, in test_10_expression_queries
142+
self.assertLess(duration, self.THRESHOLD_SLOW, "ExpressionOverlapsHere exceeded threshold")
143+
AssertionError: 137.50752902030945 not less than 15.0 : ExpressionOverlapsHere exceeded threshold
144+
145+
======================================================================
146+
FAIL: test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
147+
Test scRNAseq transcriptomics queries
148+
----------------------------------------------------------------------
149+
Traceback (most recent call last):
150+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 428, in test_11_transcriptomics_queries
151+
self.assertLess(duration, self.THRESHOLD_SLOW, "anatScRNAseqQuery exceeded threshold")
152+
AssertionError: 134.93782830238342 not less than 15.0 : anatScRNAseqQuery exceeded threshold
153+
154+
======================================================================
155+
FAIL: test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
156+
Test NBLAST similarity queries
157+
----------------------------------------------------------------------
158+
Traceback (most recent call last):
159+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 539, in test_12_nblast_queries
160+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "SimilarMorphologyToPartOfexp exceeded threshold")
161+
AssertionError: 133.54691076278687 not less than 3.0 : SimilarMorphologyToPartOfexp exceeded threshold
162+
163+
======================================================================
164+
FAIL: test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
165+
Test dataset and template queries
118166
----------------------------------------------------------------------
119-
Ran 15 tests in 64.275s
167+
Traceback (most recent call last):
168+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 602, in test_13_dataset_template_queries
169+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "PaintedDomains exceeded threshold")
170+
AssertionError: 135.85583353042603 not less than 3.0 : PaintedDomains exceeded threshold
171+
172+
======================================================================
173+
FAIL: test_14_publication_transgene_queries (src.test.test_query_performance.QueryPerformanceTest)
174+
Test publication and transgene queries
175+
----------------------------------------------------------------------
176+
Traceback (most recent call last):
177+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 689, in test_14_publication_transgene_queries
178+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "TermsForPub exceeded threshold")
179+
AssertionError: 134.45622777938843 not less than 3.0 : TermsForPub exceeded threshold
180+
181+
----------------------------------------------------------------------
182+
Ran 15 tests in 1242.656s
120183
121-
OK
184+
FAILED (failures=7)
122185
VFBquery functions patched with caching support
123186
VFBquery: SOLR caching enabled by default (3-month TTL)
124187
Disable with: export VFBQUERY_CACHE_ENABLED=false
@@ -128,146 +191,129 @@ VFBquery: SOLR caching enabled by default (3-month TTL)
128191
================================================================================
129192
TERM INFO QUERIES
130193
================================================================================
131-
get_term_info (mushroom body): 2.3683s
132-
get_term_info (individual): 2.5339s
194+
get_term_info (mushroom body): 6.9956s
195+
get_term_info (individual): 8.5556s
133196
134197
================================================================================
135198
NEURON PART OVERLAP QUERIES
136199
================================================================================
137-
NeuronsPartHere: 2.3378s
200+
NeuronsPartHere: 15.9128s
138201
139202
================================================================================
140203
SYNAPTIC TERMINAL QUERIES
141204
================================================================================
142-
NeuronsSynaptic: 2.2107s
143-
NeuronsPresynapticHere: 2.1013s
144-
NeuronsPostsynapticHere: 2.1857s
145-
NeuronNeuronConnectivity: 1.9037s
205+
NeuronsSynaptic: 8.7726s
206+
NeuronsPresynapticHere: 15.6042s
207+
NeuronsPostsynapticHere: 6.5888s
208+
NeuronNeuronConnectivity: 1.8051s
146209
147210
================================================================================
148211
ANATOMICAL HIERARCHY QUERIES
149212
================================================================================
150-
ComponentsOf: 1.7692s ✅
151-
PartsOf: 1.7630s ✅
152-
SubclassesOf: 1.7574s ✅
213+
ComponentsOf: 15.4465s ✅
153214
154215
================================================================================
155216
TRACT/NERVE AND LINEAGE QUERIES
156217
================================================================================
157-
NeuronClassesFasciculatingHere: 1.7693s
158-
TractsNervesInnervatingHere: 1.7604s
159-
LineageClonesIn: 1.7664s
218+
NeuronClassesFasciculatingHere: 10.2345s
219+
TractsNervesInnervatingHere: 6.3050s
220+
LineageClonesIn: 8.3160s
160221
161222
================================================================================
162223
IMAGE AND DEVELOPMENTAL QUERIES
163224
================================================================================
164-
ImagesNeurons: 1.7720s
165-
ImagesThatDevelopFrom: 1.7838s
166-
epFrag: 1.7635s
225+
ImagesNeurons: 12.4778s
226+
ImagesThatDevelopFrom: 11.0662s
227+
epFrag: 10.2089s
167228
168229
================================================================================
169230
INSTANCE QUERIES
170231
================================================================================
171-
ListAllAvailableImages: 1.7647s
232+
ListAllAvailableImages: 13.2370s
172233
173234
================================================================================
174235
CONNECTIVITY QUERIES
175236
================================================================================
176-
NeuronNeuronConnectivityQuery: 1.7660s
177-
NeuronRegionConnectivityQuery: 1.7998s
237+
NeuronNeuronConnectivityQuery: 3.2010s
238+
NeuronRegionConnectivityQuery: 3.4581s
178239
179240
================================================================================
180241
SIMILARITY QUERIES (Neo4j NBLAST)
181242
================================================================================
182-
SimilarMorphologyTo: 1.0433s
243+
SimilarMorphologyTo: 0.6568s
183244
184245
================================================================================
185246
NEURON INPUT QUERIES (Neo4j)
186247
================================================================================
187-
NeuronInputsTo: 3.4916s
248+
NeuronInputsTo: 405.9274s
188249
189250
================================================================================
190251
EXPRESSION PATTERN QUERIES (Neo4j)
191252
================================================================================
192-
ExpressionOverlapsHere: 3.9390s
253+
ExpressionOverlapsHere: 137.5075s
193254
└─ Found 3922 total expression patterns, returned 10
194255
195256
================================================================================
196257
TRANSCRIPTOMICS QUERIES (Neo4j scRNAseq)
197258
================================================================================
198-
anatScRNAseqQuery: 0.7731s
259+
anatScRNAseqQuery: 134.9378s
199260
└─ Found 0 total clusters
200-
clusterExpression: 1.4449s ✅
201-
└─ Found 0 genes expressed
202-
expressionCluster: 0.7145s ✅
203-
└─ Found 0 clusters expressing gene
204-
scRNAdatasetData: 0.9069s ✅
205-
└─ Found 0 clusters in dataset
206261
207262
================================================================================
208263
NBLAST SIMILARITY QUERIES
209264
================================================================================
210-
SimilarMorphologyTo: 5.0523s
265+
SimilarMorphologyTo: 0.9747s
211266
└─ Found 215 NBLAST matches, returned 10
212-
SimilarMorphologyToPartOf: 0.8313s
267+
SimilarMorphologyToPartOf: 0.6012s
213268
└─ Found 0 NBLASTexp matches
214-
SimilarMorphologyToPartOfexp: 0.8272s
269+
SimilarMorphologyToPartOfexp: 133.5469s
215270
└─ Found 0 reverse NBLASTexp matches
216-
SimilarMorphologyToNB: 0.6831s ✅
217-
└─ Found 15 NeuronBridge matches, returned 10
218-
SimilarMorphologyToNBexp: 0.7038s ✅
219-
└─ Found 15 NeuronBridge expression matches, returned 10
220-
✅ All NBLAST similarity queries completed
221271
222272
================================================================================
223273
DATASET/TEMPLATE QUERIES
224274
================================================================================
225-
PaintedDomains: 0.7336s
275+
PaintedDomains: 135.8558s
226276
└─ Found 0 painted domains
227-
DatasetImages: 0.6871s ✅
228-
└─ Found 0 images in dataset
229-
AllAlignedImages: 1.2738s ✅
230-
└─ Found 0 aligned images
231-
AlignedDatasets: 0.9392s ✅
232-
└─ Found 0 aligned datasets
233-
AllDatasets: 1.0711s ✅
234-
└─ Found 116 total datasets, returned 20
235-
✅ All dataset/template queries completed
236277
237278
================================================================================
238279
PUBLICATION/TRANSGENE QUERIES
239280
================================================================================
240-
TermsForPub: 0.6462s
281+
TermsForPub: 134.4562s
241282
└─ Found 0 terms for publication
242-
TransgeneExpressionHere: 1.6328s ✅
243-
└─ Found 2346 transgene expressions, returned 10
244-
✅ All publication/transgene queries completed
245283
246284
================================================================================
247285
PERFORMANCE TEST SUMMARY
248286
================================================================================
249287
All performance tests completed!
250288
================================================================================
251289
test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
252-
Performance test for specific term info queries. ... ok
290+
Performance test for specific term info queries. ... FAIL
291+
292+
======================================================================
293+
FAIL: test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
294+
Performance test for specific term info queries.
295+
----------------------------------------------------------------------
296+
Traceback (most recent call last):
297+
File "/home/runner/work/VFBquery/VFBquery/src/test/term_info_queries_test.py", line 590, in test_term_info_performance
298+
self.assertLess(duration_1, max_single_query_time,
299+
AssertionError: 15.537221193313599 not less than 5.0 : FBbt_00003748 query took 15.5372s, exceeding 5.0s threshold
253300
254301
----------------------------------------------------------------------
255-
Ran 1 test in 3.597s
302+
Ran 1 test in 17.063s
256303
257-
OK
304+
FAILED (failures=1)
258305
VFBquery functions patched with caching support
259306
VFBquery: SOLR caching enabled by default (3-month TTL)
260307
Disable with: export VFBQUERY_CACHE_ENABLED=false
261308
262309
==================================================
263310
Performance Test Results:
264311
==================================================
265-
FBbt_00003748 query took: 1.8087 seconds
266-
VFB_00101567 query took: 1.7878 seconds
267-
Total time for both queries: 3.5965 seconds
268-
Performance Level: 🟠 Acceptable (3-6 seconds)
312+
FBbt_00003748 query took: 15.5372 seconds
313+
VFB_00101567 query took: 1.5246 seconds
314+
Total time for both queries: 17.0618 seconds
315+
Performance Level: 🔴 Slow (> 6 seconds)
269316
==================================================
270-
Performance test completed successfully!
271317
```
272318

273319
## Summary
@@ -283,4 +329,4 @@ Track performance trends across commits:
283329
- [GitHub Actions History](https://github.com/VirtualFlyBrain/VFBquery/actions/workflows/performance-test.yml)
284330

285331
---
286-
*Last updated: 2026-02-02 04:17:08 UTC*
332+
*Last updated: 2026-02-04 04:26:45 UTC*

0 commit comments

Comments
 (0)