[ENHANCEMENT] Figure out what types of queries/questions the backend has the most trouble generating

[SethCram]

Is your feature request related to a problem? Please describe.

• Yes, it's hard to gauge how much the system should be trusted in different scenarios

Describe the solution you'd like

• Figure out what types of queries/questions the backend has the most trouble generating
• Then give report of them to client w/ stats

Additional context

• Could look at what type of questions/queries it performs the worst on when being eval'd against unseen Spider question-sql pairs
  • definitely possible since have trained model
  • look thru documentation/issues for how

Development

• get "make eval" working
  • currently crashes on my machine with docker error 137
    • runs out of memory
  • Evaluation on Spyder:
    • Should be able to get the results running "make eval"
    • Should be structured like https://github.com/taoyds/spider/blob/master/evaluation_examples/eval_result_example.txt
      • May have to change the scripting to append the natural language question to each sql vs sql gold/expected line set
      • Has useful stats at bottom
    • Spider dataset: https://github.com/taoyds/spider