List view

• Backend & Tools Consolidation

  Perform the major consolidation efforts from : https://gist.github.com/fearnworks/95ec9b90d2fd9ecb8a2890291599ba9c ``` Central Repository (OMI-Data-Repository): Handles hosted infrastructure, centralized data storage, moderation workflows, and community data input. Distributed Data Curation (graphcap): Acts as a local application that converts data assets into intermediate observations and synthesized structured outputs for downstream tasks. Distributed Data Generation (TBD): Encompasses tools for generating data (e.g., hdr_sdxl, hdr_data_instructions) and could reside as part of the data curation app or within an experimental repository. ``` ``` Cross-Language Complexity: The current split between Python (backend) and Svelte (frontend) increases the learning curve, as contributors must navigate two different ecosystems. Originally a need for this was identified due to how we wanted to do the pipeline work, but now we need to re-evaluate the need for the split. Initial design decisions assumed more substantial ML workloads on the server, prompting a distributed approach. However, after shifting db work from the FastAPI server to the Svelte backend and caption work to graphcap, we now face unnecessary complexity and cross-language dependencies ```

  No due date

  •1/4 issues closed
  25% complete3 open1 closed

• Data Repository Launch

  No due date

  •3/6 issues closed
  50% complete3 open3 closed