Rungine

TF-IDF implemented in Rust!

References

• TF-IDF
• Lexer
• XML-RS
• HTML Parser
• PDF Parser

Information

• XML-RS is a SAX parser

Left to implement

• Parse directories
• Parse files
• Create tf-idfs
• Creating word -> sorted tf-idf mapping (Index)
• Write to DB? (NoSQL?)
• Better "word" splitting create_map (Outdated link) - Solution: Lexer
• Multithread?
• PDF Support
• HTML support
• Testing using idiomatic rust instead of functional
• Clean up non-idomatic rust - i.e. to_str().clone()....bullshit