Skip to content

Commit efdcd4b

Browse files
committed
Update performance test results [skip ci]
1 parent 6bc4d6c commit efdcd4b

1 file changed

Lines changed: 119 additions & 76 deletions

File tree

performance.md

Lines changed: 119 additions & 76 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
# VFBquery Performance Test Results
22

3-
**Test Date:** 2026-02-03 04:09:44 UTC
4-
**Git Commit:** 8906834a5787f2d593938416041fcc3397ef18b2
3+
**Test Date:** 2026-02-04 04:26:45 UTC
4+
**Git Commit:** 6bc4d6ca382711555b357a9dff702dc182fffb6b
55
**Branch:** main
6-
**Workflow Run:** [21616566648](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/21616566648)
6+
**Workflow Run:** [21658000888](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/21658000888)
77

88
## Test Overview
99

@@ -91,35 +91,97 @@ Test neuron part overlap queries ... ok
9191
test_03_synaptic_queries (src.test.test_query_performance.QueryPerformanceTest)
9292
Test synaptic terminal queries ... ok
9393
test_04_anatomy_hierarchy_queries (src.test.test_query_performance.QueryPerformanceTest)
94-
Test anatomical hierarchy queries ... ok
94+
Test anatomical hierarchy queries ... FAIL
9595
test_05_tract_lineage_queries (src.test.test_query_performance.QueryPerformanceTest)
9696
Test tract/nerve and lineage clone queries ... ok
9797
test_05b_image_queries (src.test.test_query_performance.QueryPerformanceTest)
98-
Test image and developmental lineage queries ... INFO: Owlery query returned 400 Bad Request (invalid for this term type): <http://purl.obolibrary.org/obo/BFO_0000050> some <http://purl.obolibrary.org/obo/FBtp0000001>
99-
ok
98+
Test image and developmental lineage queries ... ok
10099
test_06_instance_queries (src.test.test_query_performance.QueryPerformanceTest)
101100
Test instance retrieval queries ... ok
102101
test_07_connectivity_queries (src.test.test_query_performance.QueryPerformanceTest)
103102
Test neuron connectivity queries ... ok
104103
test_08_similarity_queries (src.test.test_query_performance.QueryPerformanceTest)
105104
Test NBLAST similarity queries ... ok
106105
test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
107-
Test neuron input/synapse queries ... ok
106+
Test neuron input/synapse queries ... FAIL
108107
test_10_expression_queries (src.test.test_query_performance.QueryPerformanceTest)
109-
Test expression pattern queries ... ok
108+
Test expression pattern queries ... FAIL
110109
test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
111-
Test scRNAseq transcriptomics queries ... ok
110+
Test scRNAseq transcriptomics queries ... FAIL
112111
test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
113-
Test NBLAST similarity queries ... ok
112+
Test NBLAST similarity queries ... FAIL
114113
test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
115-
Test dataset and template queries ... ok
114+
Test dataset and template queries ... FAIL
116115
test_14_publication_transgene_queries (src.test.test_query_performance.QueryPerformanceTest)
117-
Test publication and transgene queries ... ok
116+
Test publication and transgene queries ... FAIL
118117
118+
======================================================================
119+
FAIL: test_04_anatomy_hierarchy_queries (src.test.test_query_performance.QueryPerformanceTest)
120+
Test anatomical hierarchy queries
121+
----------------------------------------------------------------------
122+
Traceback (most recent call last):
123+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 206, in test_04_anatomy_hierarchy_queries
124+
self.assertLess(duration, self.THRESHOLD_SLOW, "ComponentsOf exceeded threshold")
125+
AssertionError: 15.446540832519531 not less than 15.0 : ComponentsOf exceeded threshold
126+
127+
======================================================================
128+
FAIL: test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
129+
Test neuron input/synapse queries
130+
----------------------------------------------------------------------
131+
Traceback (most recent call last):
132+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 386, in test_09_neuron_input_queries
133+
self.assertLess(duration, self.THRESHOLD_SLOW, "NeuronInputsTo exceeded threshold")
134+
AssertionError: 405.9274363517761 not less than 15.0 : NeuronInputsTo exceeded threshold
135+
136+
======================================================================
137+
FAIL: test_10_expression_queries (src.test.test_query_performance.QueryPerformanceTest)
138+
Test expression pattern queries
139+
----------------------------------------------------------------------
140+
Traceback (most recent call last):
141+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 405, in test_10_expression_queries
142+
self.assertLess(duration, self.THRESHOLD_SLOW, "ExpressionOverlapsHere exceeded threshold")
143+
AssertionError: 137.50752902030945 not less than 15.0 : ExpressionOverlapsHere exceeded threshold
144+
145+
======================================================================
146+
FAIL: test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
147+
Test scRNAseq transcriptomics queries
148+
----------------------------------------------------------------------
149+
Traceback (most recent call last):
150+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 428, in test_11_transcriptomics_queries
151+
self.assertLess(duration, self.THRESHOLD_SLOW, "anatScRNAseqQuery exceeded threshold")
152+
AssertionError: 134.93782830238342 not less than 15.0 : anatScRNAseqQuery exceeded threshold
153+
154+
======================================================================
155+
FAIL: test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
156+
Test NBLAST similarity queries
157+
----------------------------------------------------------------------
158+
Traceback (most recent call last):
159+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 539, in test_12_nblast_queries
160+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "SimilarMorphologyToPartOfexp exceeded threshold")
161+
AssertionError: 133.54691076278687 not less than 3.0 : SimilarMorphologyToPartOfexp exceeded threshold
162+
163+
======================================================================
164+
FAIL: test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
165+
Test dataset and template queries
119166
----------------------------------------------------------------------
120-
Ran 15 tests in 76.376s
167+
Traceback (most recent call last):
168+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 602, in test_13_dataset_template_queries
169+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "PaintedDomains exceeded threshold")
170+
AssertionError: 135.85583353042603 not less than 3.0 : PaintedDomains exceeded threshold
171+
172+
======================================================================
173+
FAIL: test_14_publication_transgene_queries (src.test.test_query_performance.QueryPerformanceTest)
174+
Test publication and transgene queries
175+
----------------------------------------------------------------------
176+
Traceback (most recent call last):
177+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 689, in test_14_publication_transgene_queries
178+
self.assertLess(duration, self.THRESHOLD_MEDIUM, "TermsForPub exceeded threshold")
179+
AssertionError: 134.45622777938843 not less than 3.0 : TermsForPub exceeded threshold
180+
181+
----------------------------------------------------------------------
182+
Ran 15 tests in 1242.656s
121183
122-
OK
184+
FAILED (failures=7)
123185
VFBquery functions patched with caching support
124186
VFBquery: SOLR caching enabled by default (3-month TTL)
125187
Disable with: export VFBQUERY_CACHE_ENABLED=false
@@ -129,148 +191,129 @@ VFBquery: SOLR caching enabled by default (3-month TTL)
129191
================================================================================
130192
TERM INFO QUERIES
131193
================================================================================
132-
get_term_info (mushroom body): 2.5632s
133-
get_term_info (individual): 2.8165s
194+
get_term_info (mushroom body): 6.9956s
195+
get_term_info (individual): 8.5556s
134196
135197
================================================================================
136198
NEURON PART OVERLAP QUERIES
137199
================================================================================
138-
NeuronsPartHere: 2.4637s
200+
NeuronsPartHere: 15.9128s
139201
140202
================================================================================
141203
SYNAPTIC TERMINAL QUERIES
142204
================================================================================
143-
NeuronsSynaptic: 2.4481s
144-
NeuronsPresynapticHere: 2.2445s
145-
NeuronsPostsynapticHere: 2.3797s
146-
NeuronNeuronConnectivity: 2.0033s
205+
NeuronsSynaptic: 8.7726s
206+
NeuronsPresynapticHere: 15.6042s
207+
NeuronsPostsynapticHere: 6.5888s
208+
NeuronNeuronConnectivity: 1.8051s
147209
148210
================================================================================
149211
ANATOMICAL HIERARCHY QUERIES
150212
================================================================================
151-
ComponentsOf: 1.9015s ✅
152-
PartsOf: 1.8868s ✅
153-
SubclassesOf: 2.0236s ✅
213+
ComponentsOf: 15.4465s ✅
154214
155215
================================================================================
156216
TRACT/NERVE AND LINEAGE QUERIES
157217
================================================================================
158-
NeuronClassesFasciculatingHere: 1.8911s
159-
TractsNervesInnervatingHere: 1.8983s
160-
LineageClonesIn: 1.8984s
218+
NeuronClassesFasciculatingHere: 10.2345s
219+
TractsNervesInnervatingHere: 6.3050s
220+
LineageClonesIn: 8.3160s
161221
162222
================================================================================
163223
IMAGE AND DEVELOPMENTAL QUERIES
164224
================================================================================
165-
ImagesNeurons: 3.2078s ✅
166-
ImagesThatDevelopFrom: 9.1684s ✅
167-
ERROR: Owlery instances request failed: 400 Client Error: Bad Request for url: http://owl.virtualflybrain.org/kbs/vfb/instances?object=%3Chttp%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FBFO_0000050%3E+some+%3Chttp%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FFBtp0000001%3E&direct=false&includeDeprecated=false
168-
Test URL: http://owl.virtualflybrain.org/kbs/vfb/instances?object=%3Chttp%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FBFO_0000050%3E+some+%3Chttp%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FFBtp0000001%3E&direct=false&includeDeprecated=false
169-
epFrag: 5.5367s ✅
225+
ImagesNeurons: 12.4778s ✅
226+
ImagesThatDevelopFrom: 11.0662s ✅
227+
epFrag: 10.2089s ✅
170228
171229
================================================================================
172230
INSTANCE QUERIES
173231
================================================================================
174-
ListAllAvailableImages: 1.9267s
232+
ListAllAvailableImages: 13.2370s
175233
176234
================================================================================
177235
CONNECTIVITY QUERIES
178236
================================================================================
179-
NeuronNeuronConnectivityQuery: 1.9060s
180-
NeuronRegionConnectivityQuery: 1.8756s
237+
NeuronNeuronConnectivityQuery: 3.2010s
238+
NeuronRegionConnectivityQuery: 3.4581s
181239
182240
================================================================================
183241
SIMILARITY QUERIES (Neo4j NBLAST)
184242
================================================================================
185-
SimilarMorphologyTo: 1.1075s
243+
SimilarMorphologyTo: 0.6568s
186244
187245
================================================================================
188246
NEURON INPUT QUERIES (Neo4j)
189247
================================================================================
190-
NeuronInputsTo: 4.5545s
248+
NeuronInputsTo: 405.9274s
191249
192250
================================================================================
193251
EXPRESSION PATTERN QUERIES (Neo4j)
194252
================================================================================
195-
ExpressionOverlapsHere: 2.1688s
253+
ExpressionOverlapsHere: 137.5075s
196254
└─ Found 3922 total expression patterns, returned 10
197255
198256
================================================================================
199257
TRANSCRIPTOMICS QUERIES (Neo4j scRNAseq)
200258
================================================================================
201-
anatScRNAseqQuery: 1.0012s
259+
anatScRNAseqQuery: 134.9378s
202260
└─ Found 0 total clusters
203-
clusterExpression: 1.0503s ✅
204-
└─ Found 0 genes expressed
205-
expressionCluster: 0.7539s ✅
206-
└─ Found 0 clusters expressing gene
207-
scRNAdatasetData: 0.9218s ✅
208-
└─ Found 0 clusters in dataset
209261
210262
================================================================================
211263
NBLAST SIMILARITY QUERIES
212264
================================================================================
213-
SimilarMorphologyTo: 2.6130s
265+
SimilarMorphologyTo: 0.9747s
214266
└─ Found 215 NBLAST matches, returned 10
215-
SimilarMorphologyToPartOf: 0.8968s
267+
SimilarMorphologyToPartOf: 0.6012s
216268
└─ Found 0 NBLASTexp matches
217-
SimilarMorphologyToPartOfexp: 0.7322s
269+
SimilarMorphologyToPartOfexp: 133.5469s
218270
└─ Found 0 reverse NBLASTexp matches
219-
SimilarMorphologyToNB: 0.8312s ✅
220-
└─ Found 15 NeuronBridge matches, returned 10
221-
SimilarMorphologyToNBexp: 0.7315s ✅
222-
└─ Found 15 NeuronBridge expression matches, returned 10
223-
✅ All NBLAST similarity queries completed
224271
225272
================================================================================
226273
DATASET/TEMPLATE QUERIES
227274
================================================================================
228-
PaintedDomains: 0.7476s
275+
PaintedDomains: 135.8558s
229276
└─ Found 0 painted domains
230-
DatasetImages: 0.9057s ✅
231-
└─ Found 0 images in dataset
232-
AllAlignedImages: 0.7199s ✅
233-
└─ Found 0 aligned images
234-
AlignedDatasets: 1.0457s ✅
235-
└─ Found 0 aligned datasets
236-
AllDatasets: 0.9588s ✅
237-
└─ Found 116 total datasets, returned 20
238-
✅ All dataset/template queries completed
239277
240278
================================================================================
241279
PUBLICATION/TRANSGENE QUERIES
242280
================================================================================
243-
TermsForPub: 1.6021s
281+
TermsForPub: 134.4562s
244282
└─ Found 0 terms for publication
245-
TransgeneExpressionHere: 0.9890s ✅
246-
└─ Found 2346 transgene expressions, returned 10
247-
✅ All publication/transgene queries completed
248283
249284
================================================================================
250285
PERFORMANCE TEST SUMMARY
251286
================================================================================
252287
All performance tests completed!
253288
================================================================================
254289
test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
255-
Performance test for specific term info queries. ... ok
290+
Performance test for specific term info queries. ... FAIL
291+
292+
======================================================================
293+
FAIL: test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
294+
Performance test for specific term info queries.
295+
----------------------------------------------------------------------
296+
Traceback (most recent call last):
297+
File "/home/runner/work/VFBquery/VFBquery/src/test/term_info_queries_test.py", line 590, in test_term_info_performance
298+
self.assertLess(duration_1, max_single_query_time,
299+
AssertionError: 15.537221193313599 not less than 5.0 : FBbt_00003748 query took 15.5372s, exceeding 5.0s threshold
256300
257301
----------------------------------------------------------------------
258-
Ran 1 test in 4.165s
302+
Ran 1 test in 17.063s
259303
260-
OK
304+
FAILED (failures=1)
261305
VFBquery functions patched with caching support
262306
VFBquery: SOLR caching enabled by default (3-month TTL)
263307
Disable with: export VFBQUERY_CACHE_ENABLED=false
264308
265309
==================================================
266310
Performance Test Results:
267311
==================================================
268-
FBbt_00003748 query took: 2.2582 seconds
269-
VFB_00101567 query took: 1.9065 seconds
270-
Total time for both queries: 4.1646 seconds
271-
Performance Level: 🟠 Acceptable (3-6 seconds)
312+
FBbt_00003748 query took: 15.5372 seconds
313+
VFB_00101567 query took: 1.5246 seconds
314+
Total time for both queries: 17.0618 seconds
315+
Performance Level: 🔴 Slow (> 6 seconds)
272316
==================================================
273-
Performance test completed successfully!
274317
```
275318

276319
## Summary
@@ -286,4 +329,4 @@ Track performance trends across commits:
286329
- [GitHub Actions History](https://github.com/VirtualFlyBrain/VFBquery/actions/workflows/performance-test.yml)
287330

288331
---
289-
*Last updated: 2026-02-03 04:09:44 UTC*
332+
*Last updated: 2026-02-04 04:26:45 UTC*

0 commit comments

Comments
 (0)