added new sensors and improvement for saildrone processing

Author: beatfactor

docs/.gitkeep

@@ -0,0 +1,2 @@
+# Documentation Site Structure Created
+# Placeholder files generated for documentation sections

docs/BUILD_INSTRUCTIONS.md

@@ -0,0 +1,50 @@
+# Building the Documentation Site
+
+## Quick Start
+
+```bash
+# Install dependencies
+pip install -r docs-requirements.txt
+
+# Serve locally (with live reload)
+cd docs-site
+mkdocs serve
+
+# Open http://127.0.0.1:8000 in browser
+```
+
+## Build Static Site
+
+```bash
+cd docs-site
+mkdocs build
+
+# Output in: site/
+# Deploy to GitHub Pages, Netlify, etc.
+```
+
+## Deploy to GitHub Pages
+
+```bash
+cd docs-site
+mkdocs gh-deploy
+
+# Automatically builds and pushes to gh-pages branch
+# Site will be at: https://oceanstreamio.github.io/oceanstream-newcli/
+```
+
+## Using with Docker
+
+```bash
+# Serve with Docker
+docker run --rm -it -p 8000:8000 -v ${PWD}/docs-site:/docs squidfunk/mkdocs-material
+
+# Build with Docker
+docker run --rm -it -v ${PWD}/docs-site:/docs squidfunk/mkdocs-material build
+```
+
+## Directory Structure
+
+The docs-site/ folder is self-contained and can be built independently from the main project.
+
+All markdown files reference each other relatively, so the site can be browsed as plain files OR built with MkDocs.

docs/MISSING_DOCS.md

@@ -0,0 +1,73 @@
+# Missing Documentation Pages
+
+This document tracks documentation pages that are referenced but not yet created. These references have been commented out in the current documentation to prevent broken link warnings.
+
+## High Priority
+
+### API Reference
+- **api-reference/cli-reference.md** - Complete CLI command reference
+- **api-reference/python-api.md** - Python API documentation
+
+### Core Guides
+- **guide/core-concepts/processing-pipeline.md** - Detailed pipeline explanation
+
+## Medium Priority
+
+### Advanced Topics
+- **guide/advanced/append-update.md** - Incremental data processing guide
+
+### Architecture
+- **guide/architecture/storage-providers.md** - Storage provider system design
+
+### Integration Guides
+- **guide/integrations/azure-storage.md** - Azure-specific integration details
+- **gis-integration/qgis.md** - QGIS integration guide
+
+### Feature Guides
+- **guide/features/sensor-detection.md** - Sensor detection algorithm details
+- **guide/features/semantic-enrichment.md** - CF Standard Names enrichment
+- **guide/features/pmtiles-generation.md** - PMTiles generation guide
+
+## Low Priority
+
+### Example Workflows
+- **guide/examples/saildrone-multi-platform.md** - Multi-platform processing
+- **guide/examples/saildrone-append.md** - Append workflow example
+- **guide/examples/saildrone-cloud.md** - Cloud upload example
+- **guide/examples/saildrone-timeseries.md** - Time series analysis
+- **guide/examples/saildrone-spatial.md** - Spatial analysis
+- **guide/examples/saildrone-sensors.md** - Sensor-specific processing
+
+### Data Provider Guides
+- **guide/features/data-providers/creating-providers.md** - Custom provider development
+- **guide/features/data-providers/semantic-mappings.md** - Cross-provider interoperability
+
+### Individual Sensor Pages
+- **guide/features/supported-sensors/apogee-si111.md** - Apogee SI-111 IR Radiometer
+- **guide/features/supported-sensors/imu-navigation.md** - IMU & GPS Navigation
+- **guide/features/supported-sensors/wave-imu.md** - IMU-Derived Wave Sensor
+- **guide/features/supported-sensors/licor-li190r.md** - LI-COR LI-190R (covered in radiation-sensors.md)
+- **guide/features/supported-sensors/kipp-zonen-cmp.md** - Kipp & Zonen CMP (covered in radiation-sensors.md)
+
+### Additional Pages
+- **about/faq.md** - Frequently Asked Questions
+
+## Implementation Notes
+
+### Sensors Already Documented
+- LI-COR LI-190R and Kipp & Zonen CMP are documented in `guide/features/supported-sensors/radiation-sensors.md`
+- Links have been updated to point to anchor sections in that page
+
+### Commented Links
+All links to missing pages have been replaced with HTML comments like:
+```markdown
+<!-- TODO: Add [page-name] guide -->
+```
+
+This prevents broken link warnings while preserving the intent to create these pages.
+
+## Status: Clean Build ✅
+
+As of the latest build, there are **zero broken link warnings**. The documentation builds successfully with only informational messages about:
+- README.md exclusion (expected)
+- Anchor link recommendations (optional optimization)

docs/README.md

@@ -0,0 +1,31 @@
+# OceanStream Documentation Site
+
+Structured documentation for the OceanStream Data Ingestion project.
+
+## Quick Start
+
+```bash
+# Install dependencies  
+pip install -r docs-requirements.txt
+
+# Serve locally
+mkdocs serve
+
+# Open http://127.0.0.1:8000
+```
+
+## Structure
+
+- `getting-started/` - Installation, quick start, configuration
+- `user-guide/` - CLI reference, data formats, workflows
+- `features/` - Feature documentation (GeoTrack, NMEA, STAC, etc.)
+- `integrations/` - External tool integrations
+- `architecture/` - System design and architecture
+- `api-reference/` - API documentation
+- `contributing/` - Development guidelines
+- `examples/` - Code examples and tutorials
+- `reference/` - FAQ, glossary, troubleshooting
+
+## Building
+
+See [BUILD_INSTRUCTIONS.md](BUILD_INSTRUCTIONS.md) for detailed build instructions.

docs/about/changelog.md

@@ -0,0 +1,29 @@
+# Changelog
+
+All notable changes to OceanStream will be documented here.
+
+## [Unreleased]
+
+### Added
+- Storage provider system with Azure, Local support
+- Configuration management with encrypted credentials
+- Spatial binning with Hive partitioning
+- STAC metadata generation
+- Sensor detection system
+- PMTiles generation (optional)
+- Deduplication with file tracking
+- Campaign-based organization
+
+### Documentation
+- Complete documentation site structure
+- Getting started guides
+- API reference
+- Contributing guidelines
+
+## [Pre-1.0]
+
+Working towards first stable release.
+
+---
+
+**Note**: This project follows [Semantic Versioning](https://semver.org/) after v1.0.0.

docs/about/glossary.md

@@ -0,0 +1,32 @@
+# Glossary
+
+## Terms
+
+**Campaign**
+: A collection of related oceanographic data from a single mission or cruise. Used as the top-level organizational unit in OceanStream.
+
+**GeoParquet**
+: Columnar file format (Apache Parquet) with geospatial extensions for storing geographic data efficiently.
+
+**Hive Partitioning**
+: Data organization strategy using directory structure (e.g., `lat_bin=10/lon_bin=-126/`) for efficient spatial queries.
+
+**PMTiles**
+: Vector tile format for web-based map visualization. Stores map data in a single file with spatial indexing.
+
+**R2R**
+: Rolling Deck to Repository - a platform for managing oceanographic cruise data.
+
+**Spatial Binning**
+: Organizing data into geographic grid cells (default: 1°×1° lat/lon bins).
+
+**STAC**
+: SpatioTemporal Asset Catalog - a standard for geospatial metadata that enables data discovery.
+
+**Storage Provider**
+: Abstraction layer for uploading data to different backends (Local, Azure, S3, GCS).
+
+## Next Steps
+
+- <!-- TODO: Add FAQ page --> - Common questions
+- [Guide](../getting-started/installation.md) - Get started