DataPilot/pipeline.log at main · CalebJKim/DataPilot · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: all-MiniLM-L6-v2
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: all-MiniLM-L6-v2
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: all-MiniLM-L6-v2
INFO:chromadb.telemetry.product.posthog:Anonymized telemetry enabled. See                     https://docs.trychroma.com/telemetry for more information.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.1349 seconds
INFO:root:Time to clean SQL query: 0.0003 seconds
INFO:root:Total time for SQL generation: 1.1357 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.3549 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.3557 seconds
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.9406 seconds
INFO:root:Time to clean SQL query: 0.0006 seconds
INFO:root:Total time for SQL generation: 0.9418 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:werkzeug:[31m[1mWARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.[0m
 * Running on http://127.0.0.1:5000
INFO:werkzeug:[33mPress CTRL+C to quit[0m
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.9220 seconds
INFO:root:Time to clean SQL query: 0.0003 seconds
INFO:root:Total time for SQL generation: 0.9226 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.445258 seconds
INFO:werkzeug:[31m[1mWARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.[0m
 * Running on http://127.0.0.1:5000
INFO:werkzeug:[33mPress CTRL+C to quit[0m
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.7809 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 0.7817 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.443868 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.949696 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:werkzeug:127.0.0.1 - - [19/Dec/2024 22:15:00] "[35m[1mPOST /api/llm-query HTTP/1.1[0m" 500 -
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.1207 seconds
INFO:root:Time to clean SQL query: 0.0007 seconds
INFO:root:Total time for SQL generation: 1.1220 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.408632 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.754031 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0508 seconds
INFO:root:Time to clean SQL query: 0.0003 seconds
INFO:root:Total time for SQL generation: 1.0515 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.435978 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.850080 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0028 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.0035 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.444164 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.790610 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0023 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.0033 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.461075 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.843621 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0768 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.0776 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.418555 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.843266 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.1511 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.1520 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.439078 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.978961 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.1659 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.1668 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.1092 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 1.1100 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0237 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 1.0243 seconds
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 1.0410 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 1.0415 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.413599 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.886478 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8248 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 0.8257 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.424894 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:openai._base_client:Retrying request to /chat/completions in 0.854651 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 429 Too Many Requests"
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.9108 seconds
INFO:root:Time to clean SQL query: 0.0004 seconds
INFO:root:Total time for SQL generation: 0.9116 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8379 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 0.8385 seconds
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8460 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 0.8467 seconds
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
INFO:werkzeug:[31m[1mWARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.[0m
 * Running on http://127.0.0.1:5000
INFO:werkzeug:[33mPress CTRL+C to quit[0m
INFO:root:Loaded carsalesdata.csv with 17662 rows.
INFO:root:Data cleaned. Dropped NA values.
INFO:root:Data saved to SQLite database.
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8446 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 0.8449 seconds
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8318 seconds
INFO:root:Time to clean SQL query: 0.0000 seconds
INFO:root:Total time for SQL generation: 0.8320 seconds
INFO:root:Formatted prompt prepared.
INFO:root:Time for invoke in SQL generation: 0.8567 seconds
INFO:root:Time to clean SQL query: 0.0001 seconds
INFO:root:Total time for SQL generation: 0.8573 seconds
INFO:werkzeug:127.0.0.1 - - [19/Dec/2024 23:21:25] "POST /api/llm-query HTTP/1.1" 200 -