shard table#4488
Open
tomatolog wants to merge 4 commits into
Open
Conversation
Contributor
Linux debug test results1 188 tests 1 123 ✅ 45m 45s ⏱️ Results for commit ec351ee. ♻️ This comment has been updated with latest results. |
Contributor
Linux release test results1 188 tests 1 123 ✅ 17m 30s ⏱️ Results for commit ec351ee. ♻️ This comment has been updated with latest results. |
Contributor
Linux release MCL test results1 185 tests 1 164 ✅ 18m 15s ⏱️ Results for commit ec351ee. ♻️ This comment has been updated with latest results. |
Contributor
clt❌ CLT tests in Failed tests:🔧 Edit failed tests in UI: test/clt-tests/mysqldump/mysql/pq-table-mysqldump.rec––– input –––
rm -f /var/log/manticore/searchd.log; stdbuf -oL searchd --stopwait > /dev/null; stdbuf -oL searchd ${SEARCHD_ARGS:-} > /dev/null
––– output –––
OK
––– input –––
if timeout 10 grep -qm1 'accepting connections' <(tail -n 1000 -f /var/log/manticore/searchd.log); then echo 'Accepting connections!'; else echo 'Timeout or failed!'; fi
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "create table pq(f text) type='percolate'"
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "insert into pq(id, query) values(1, '@f abc'),(2, 'def')"
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "select * from pq"
––– output –––
OK
––– input –––
mysqldump -h0 -P9306 manticore 2>/dev/null 1> /tmp/pq-dump.sql
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e 'drop table pq'
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e 'show tables'
––– output –––
OK
––– input –––
mysql -h0 -P9306 manticore < /tmp/pq-dump.sql
––– output –––
+ ERROR 1064 (42000) at line 32: column count does not match schema (expected 2, got 8)
––– input –––
mysql -h0 -P9306 -e 'select * from pq;'
––– output –––
- +------+--------+------+---------+
- | id | query | tags | filters |
- +------+--------+------+---------+
- | 2 | def | | |
- | 1 | @f abc | | |
- +------+--------+------+---------+ |
Contributor
clt❌ CLT tests in Failed tests:🔧 Edit failed tests in UI:
test/clt-tests/mysqldump/maria/pq-table-mysqldump.rec––– input –––
rm -f /var/log/manticore/searchd.log; stdbuf -oL searchd --stopwait > /dev/null; stdbuf -oL searchd ${SEARCHD_ARGS:-} > /dev/null
––– output –––
OK
––– input –––
if timeout 10 grep -qm1 'accepting connections' <(tail -n 1000 -f /var/log/manticore/searchd.log); then echo 'Accepting connections!'; else echo 'Timeout or failed!'; fi
––– output –––
OK
––– input –––
apt-get -yqq update > /dev/null 2>&1; echo $?
––– output –––
OK
––– input –––
apt -yqq install mariadb-server > /dev/null 2>&1; echo $?
––– output –––
OK
––– input –––
mysqldump --version
––– output –––
OK
––– input –––
echo '[mysql]'$'\n''table=TRUE' >> ~/.my.cnf
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "create table pq(f text) type='percolate'"
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "insert into pq(id, query) values(1, '@f abc'),(2, 'def')"
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e "select * from pq"
––– output –––
OK
––– input –––
mysqldump -h0 -P9306 manticore 2>/dev/null 1> /tmp/pq-dump.sql
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e 'drop table pq'
––– output –––
OK
––– input –––
mysql -P9306 -h0 -e 'show tables'
––– output –––
OK
––– input –––
mysql -h0 -P9306 manticore < /tmp/pq-dump.sql
––– output –––
+ --------------
+ INSERT INTO `pq` VALUES
+ ('1','@f abc','',''),
+ ('2','def','','')
+ --------------
+ ERROR 1064 (42000) at line 33: column count does not match schema (expected 2, got 8)
––– input –––
mysql -h0 -P9306 -e 'select * from pq;'
––– output –––
- +------+--------+------+---------+
- | id | query | tags | filters |
- +------+--------+------+---------+
- | 2 | def | | |
- | 1 | @f abc | | |
- +------+--------+------+---------+test/clt-tests/performance/test-show-table-tbl-name-status.rec––– input –––
export INSTANCE=1
––– output –––
OK
––– input –––
mkdir -p /var/{run,lib,log}/manticore-${INSTANCE}
––– output –––
OK
––– input –––
stdbuf -oL searchd -c test/clt-tests/base/searchd-with-flexible-ports.conf > /dev/null
––– output –––
OK
––– input –––
if timeout 10 grep -qm1 '\[BUDDY\] started' <(tail -n 1000 -f /var/log/manticore-${INSTANCE}/searchd.log); then echo 'Buddy started!'; else echo 'Timeout or failed!'; cat /var/log/manticore-${INSTANCE}/searchd.log; fi
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "CREATE TABLE video_rt (id BIGINT, title TEXT, content TEXT, created_at BIGINT) morphology='stem_en'"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "CREATE TABLE tencent_rt (id BIGINT, title TEXT, category INT, views BIGINT) morphology='stem_en'"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "command_" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 0
command_excerpt 0
command_getfield 0
command_insert 0
command_keywords 0
command_replace 0
command_search 0
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 1
- command_update 0
+ command_suggest 0
+ command_update 0
––– input –––
mysql -h0 -P1306 -e "INSERT INTO video_rt (id, title, content, created_at) VALUES (1, 'Test Video 1', 'Content about cats and dogs', 1640995200)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "INSERT INTO video_rt (id, title, content, created_at) VALUES (2, 'Test Video 2', 'Content about technology', 1640995300)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "INSERT INTO tencent_rt (id, title, category, views) VALUES (1, 'Tencent News 1', 100, 1500)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "REPLACE INTO video_rt (id, title, content, created_at) VALUES (3, 'Replaced Video', 'New content', 1640995400)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "REPLACE INTO tencent_rt (id, title, category, views) VALUES (2, 'Tencent Replace', 200, 2500)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT * FROM video_rt WHERE MATCH('cats') \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT * FROM video_rt WHERE MATCH('technology') \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT * FROM video_rt WHERE id > 0 \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT * FROM tencent_rt WHERE category = 100 \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT COUNT(*) FROM tencent_rt \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "UPDATE video_rt SET created_at = 1640995500 WHERE id = 2"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "UPDATE tencent_rt SET views = 3000 WHERE id = 1"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "DELETE FROM video_rt WHERE id = 3"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "INSERT INTO tencent_rt (id, title, category, views) VALUES (3, 'Test Delete Record', 300, 500)"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "DELETE FROM tencent_rt WHERE id = 3"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "COMMIT"; echo $?
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "command_" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 1
command_excerpt 0
command_getfield 0
command_insert 2
command_keywords 0
command_replace 1
command_search 3
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 2
- command_update 1
+ command_suggest 0
+ command_update 1
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX tencent_rt STATUS" | grep -E "command_" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 1
command_excerpt 0
command_getfield 0
command_insert 2
command_keywords 0
command_replace 1
command_search 2
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 1
- command_update 1
+ command_suggest 0
+ command_update 1
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "(insert_replace_stats_ms|search_stats_ms|update_stats_ms)" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "(query_time_total|found_rows_total)" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "(command_|_stats_ms_|query_time_|found_rows_)" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 1
command_excerpt 0
command_getfield 0
command_insert 2
command_keywords 0
command_replace 1
command_search 3
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 5
- command_update 1
+ command_suggest 0
- found_rows_15min {"queries":3,
+ command_update 1
- found_rows_1min {"queries":3,
+ found_rows_15min {"queries":3,
- found_rows_5min {"queries":3,
+ found_rows_1min {"queries":3,
- found_rows_total {"queries":3,
+ found_rows_5min {"queries":3,
- insert_replace_stats_ms_avg #!/[0-9]{1}.[0-9]{3}/!#
+ found_rows_total {"queries":3,
- insert_replace_stats_ms_max #!/[0-9]{1}.[0-9]{3}/!#
+ insert_replace_stats_ms_avg 1.164
- insert_replace_stats_ms_min #!/[0-9]{1}.[0-9]{3}/!#
+ insert_replace_stats_ms_max 1.838
- insert_replace_stats_ms_pct95 #!/[0-9]{1}.[0-9]{3}/!#
+ insert_replace_stats_ms_min 0.316
- insert_replace_stats_ms_pct99 #!/[0-9]{1}.[0-9]{3}/!#
+ insert_replace_stats_ms_pct95 1.588
- query_time_15min {"queries":3,
+ insert_replace_stats_ms_pct99 1.588
- query_time_1min {"queries":3,
+ query_time_15min {"queries":3,
- query_time_5min {"queries":3,
+ query_time_1min {"queries":3,
- query_time_total {"queries":3,
+ query_time_5min {"queries":3,
- search_stats_ms_avg #!/[0-9]{1}.[0-9]{3}/!#
+ query_time_total {"queries":3,
- search_stats_ms_max #!/[0-9]{1}.[0-9]{3}/!#
+ search_stats_ms_avg 0.123
- search_stats_ms_min #!/[0-9]{1}.[0-9]{3}/!#
+ search_stats_ms_max 0.189
- search_stats_ms_pct95 #!/[0-9]{1}.[0-9]{3}/!#
+ search_stats_ms_min 0.082
- search_stats_ms_pct99 #!/[0-9]{1}.[0-9]{3}/!#
+ search_stats_ms_pct95 0.144
- update_stats_ms_avg #!/[0-9]{1}.[0-9]{3}/!#
+ search_stats_ms_pct99 0.144
- update_stats_ms_max #!/[0-9]{1}.[0-9]{3}/!#
+ update_stats_ms_avg 0.068
- update_stats_ms_min #!/[0-9]{1}.[0-9]{3}/!#
+ update_stats_ms_max 0.068
- update_stats_ms_pct95 #!/[0-9]{1}.[0-9]{3}/!#
+ update_stats_ms_min 0.068
- update_stats_ms_pct99 #!/[0-9]{1}.[0-9]{3}/!#
+ update_stats_ms_pct95 0.068
+ update_stats_ms_pct99 0.068
––– input –––
mysql -h0 -P1306 -e "CALL KEYWORDS('cats dogs', 'video_rt') \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "command_keywords" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "CALL KEYWORDS('tencent news', 'tencent_rt') \G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SELECT SNIPPET(content, 'cats') as excerpt FROM video_rt WHERE MATCH('cats')\G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "CALL SNIPPETS('Content about cats and dogs', 'video_rt', 'cats')\G"
––– output –––
OK
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX video_rt STATUS" | grep -E "command_" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 1
command_excerpt 1
command_getfield 0
command_insert 2
command_keywords 1
command_replace 1
command_search 4
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 7
- command_update 1
+ command_suggest 0
+ command_update 1
––– input –––
mysql -h0 -P1306 -e "SHOW INDEX tencent_rt STATUS" | grep -E "command_" | tr -d '|' | awk '{print $1, $2}' | sort
––– output –––
command_callpq 0
command_commit 0
command_delete 1
command_excerpt 0
command_getfield 0
command_insert 2
command_keywords 1
command_replace 1
command_search 2
- command_status %{NUMBER}
+ command_shard_write 0
- command_suggest 0
+ command_status 2
- command_update 1
+ command_suggest 0
+ command_update 1 |
Contributor
clt❌ CLT tests in Failed tests:🔧 Edit failed tests in UI: test/clt-tests/buddy-plugins/test-prometheus-exporter.rec––– input –––
export SEARCHD_FLAGS="--iostats --cpustats"
––– output –––
OK
––– input –––
rm -f /var/log/manticore/searchd.log; stdbuf -oL searchd $SEARCHD_FLAGS > /dev/null; if timeout 10 grep -qm1 '\[BUDDY\] started' <(tail -n 1000 -f /var/log/manticore/searchd.log); then echo 'Buddy started!'; else echo 'Timeout or failed!'; cat /var/log/manticore/searchd.log;fi
––– output –––
OK
––– input –––
curl -s 0:9308/metrics > /tmp/exporter_unfiltered_output.txt
––– output –––
OK
––– input –––
cat /tmp/exporter_unfiltered_output.txt | grep -e "^manticore" | cut -d" " -f1 | sed 's/^manticore_//' | sed 's/qcache_thresh_microseconds/qcache_thresh_msec/' | sort > /tmp/exporter_output.txt
––– output –––
OK
––– input –––
searchd --iostats --cpustats --status | cut -d":" -f1 | tail -n +10 | sort > /tmp/searchd_output.txt
––– output –––
OK
––– input –––
ls -1 /tmp | grep -E "^(exporter|searchd).*\.txt$"
––– output –––
OK
––– input –––
cat /tmp/exporter_unfiltered_output.txt | grep "Warning"
––– output –––
OK
––– input –––
while read -r line; do grep -q "^$line" /tmp/exporter_output.txt || echo "$line"; done < /tmp/searchd_output.txt
––– output –––
+ command_shard_write
––– input –––
echo "new-option" >> /tmp/searchd_output.txt
––– output –––
OK
––– input –––
while read -r line; do grep -q "^$line" /tmp/exporter_output.txt || echo "$line"; done < /tmp/searchd_output.txt
––– output –––
- new-option
+ command_shard_write
+ new-option |
…printer); fixed CLT for new api command counter
Member
|
I merged all fixes in once, cuz they are all coupled. So lets continue there: #4537 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
to run all CI stages