Merge pull request #154 from MetaCell/release/0.4.0

Release/0.4.0

Author: filippomc

.travis.yml

@@ -1,6 +1,6 @@
 language: node_js
 node_js:
-  - "9"
+  - "13"
 cache: 
   - pip
   - npm

Dockerfile

@@ -5,6 +5,9 @@ ENV FOLDER=nwb-explorer
 USER root
 RUN apt-get update -qq &&\
     apt-get install python3-tk vim nano unzip -qq
+RUN npm i -g npm@6
+
+RUN chown -R 1000:100 $HOME/.npm
 USER $NB_UID
 
 RUN jupyter labextension disable @jupyterlab/hub-extension

README.md

@@ -39,19 +39,37 @@ conda create -n nwb-explorer python=3.7
 conda activate nwb-explorer
 ```
 
-### Local installation
+### Clone "nwb-explorer" Repository
 
-Instructions to get a development environment running.
+Clone repository using the development branch:
 
 ```bash
 git clone -b development https://github.com/MetaCell/nwb-explorer
+```
+
+### Run via Docker
+
+There is a [Dockerfile](./Dockerfile) ready to build a container for NWB-Explorer:
+
+```bash
+cd nwb-explorer
+docker build -t nwb-explorer .
+docker run -it -p8888:8888 nwb-explorer
+```
+Then, after the Docker contained has started, the application is ready at http://localhost:8888
+
+### Local Installation without Docker
+
+Instructions to get a development environment running.
+
+```bash
 cd nwb-explorer
 python utilities/install.py
 ```
 
 ## How to run NWB Explorer
 
-After the installation is complete, run the script:
+After the local installation is complete, run the script:
 
 ```bash
 cd nwb-explorer
@@ -81,7 +99,7 @@ pip install -e .
 
 ### Javascript code from sources
 
-JS/HTML code can be found inside `static/org.geppetto.frontend/src/main/webapp/`. The code needs to be rebuilt with webpack everytime there is a change. To avoid having to do so you can use the Webpack development server running in `/static/org.geppetto.frontend/src/main/webapp/` this command:
+JS/HTML code can be found inside `webapp/`. The code needs to be rebuilt with webpack everytime there is a change. To avoid having to do so you can use the Webpack development server running in `webapp/` this command:
 
 ```bash
 npm run build-dev-noTest:watch
@@ -91,17 +109,6 @@ This will spawn a process that while left running will watch for any changes on
 
 To check if a dependency is installed in development mode, run `pip list`.
 
-### Run via Docker
-
-There is a dockerfile ready to build a container for NWB-Explorer:
-
-```bash
-cd nwb-explorer/k8s
-docker build -t nwb-explorer .
-docker run -it -p8888:8888 nwb-explorer
-```
-Then, after the docker contained has started, the application is ready http://localhost:8888/geppetto
-
 ## Built With
 
 * [Geppetto](http://www.geppetto.org/) - Used to build a web-based application to interpret and visualize the NWB:N 2 files.
@@ -111,11 +118,11 @@ Then, after the docker contained has started, the application is ready http://lo
 
 ## Background
 
-The NWB Explorer was initially created by MetaCell to showcase the features of the Geppetto platform to share
-neurophysiological data in Neurodata Without Borders format. It was further developed as part of a
-Google Summer of Code project with the OpenWorm project. It is currently being extended as part of the Open Source Brain
+The NWB Explorer was initially created by [MetaCell](http://metacell.us) to showcase the features of the [Geppetto](http://www.geppetto.org/) platform to share
+neurophysiological data in [Neurodata Without Borders](https://www.nwb.org/) format. It was further developed as part of a
+[Google Summer of Code](https://summerofcode.withgoogle.com/) project for the [OpenWorm project](http://openworm.org/). It is currently being extended as part of the [Open Source Brain](http://www.opensourcebrain.org/)
 project to provide both a standalone and online application for visualising and analysing the contents of NWB:N 2 files.
-This work is currently funded by the Wellcome Trust.
+This work is currently funded by the [Wellcome Trust](https://wellcome.ac.uk/).
 
 ## Authors
 

k8s/auth.py

@@ -36,7 +36,7 @@ def get(self):
         redirection = self.get_next_url(user)
         user.spawners[server_name].environment["NWBFILE"] = ''
 
-        if 'hub/nwbfile=' in self.request.uri:
+        if 'nwbfile=' in self.request.uri:
             server_name = str(uuid.uuid4()).split('-').pop()
             redirection = f'/hub/spawn/{user.name}/{server_name}'
             url = self.request.uri.split('=').pop()

nwb-extensions/README.md

@@ -0,0 +1,3 @@
+# Custom pynwb extensions
+
+Place your extensions here

nwb-extensions/silverlab/init.py

@@ -0,0 +1 @@
+pynwb.get_class('ZplanePockelsDataset', 'silverlab_extended_schema')

nwb-extensions/silverlab/silverlab.metadata.yaml

@@ -0,0 +1,9 @@
+groups:
+- neurodata_type_def: SilverLabMetaData
+  neurodata_type_inc: LabMetaData
+  doc: A place to store Silver lab specific metadata
+  attributes:
+  - name: silverlab_api_version
+    dtype: text
+    doc: For potential future backwards compatibility, store the 'version' of this
+      API that created the file.

nwb-extensions/silverlab/silverlab.namespace.yaml

@@ -0,0 +1,11 @@
+namespaces:
+- doc: Extensions for acousto-optic lens data
+  full_name: Silver lab data extension to NWB format for acousto-optic lens experiments
+  name: silverlab_extended_schema
+  schema:
+  - namespace: core
+    neurodata_types:
+    - LabMetaData
+  - source: silverlab.ophys.yaml
+  - source: silverlab.metadata.yaml
+  version: '0.2'

nwb-extensions/silverlab/silverlab.ophys.yaml

@@ -0,0 +1,36 @@
+groups:
+- neurodata_type_def: SilverLabOptophysiology
+  neurodata_type_inc: LabMetaData
+  doc: A place to store Silver lab specific optophysiology data
+  attributes:
+  - name: cycle_time
+    dtype: float
+    doc: time in seconds for the microscope to acquire all ROIs once and return to
+      its starting position
+  - name: cycles_per_trial
+    dtype: int
+    doc: how many microscope cycles occur in each experimental trial
+  - name: frame_size
+    dtype: int
+    shape:
+    - 2
+    doc: the 2d imaging frame size in voxels
+  - name: imaging_mode
+    dtype: text
+    doc: the acquisition mode for the experiment; pointing = single-voxel ROIs, miniscan
+      = 2d rectangular ROIs, volume = 3d cuboid ROIs
+  datasets:
+  - neurodata_type_def: ZplanePockelsDataset
+    name: pockels
+    shape:
+    - null
+    - 4
+    doc: "pockels data set, recording calibration data for focusing at different z-planes\
+      \ in four columns: Z offset from focal plane (micrometres), normalised Z, 'Pockels'\
+      \ i.e. laser power in %, and z offset for drive motors"
+    attributes:
+    - name: columns
+      dtype: text
+      shape:
+      - 4
+      doc: column names for the zplane pockels dataset

nwb_explorer/__init__.py

@@ -1,4 +1,8 @@
 import logging
+import glob
+import os
+import pynwb
+from pynwb import load_namespaces
 
 from jupyter_geppetto.webapi import RouteManager
 from pygeppetto.services import model_interpreter, data_manager
@@ -7,6 +11,8 @@
 from nwb_explorer.nwb_data_manager import NWBDataManager
 from nwb_explorer.nwb_model_interpreter import NWBModelInterpreter
 
+EXTENSION_PATH = 'nwb-extensions'
+
 # Add REST API
 RouteManager.add_controller(api.NWBController)
 logging.info("Adding NWBModelInterpreter")
@@ -16,3 +22,24 @@
 logging.info("Adding NWBDataManager")
 # Replace data manager
 data_manager.set_data_manager(NWBDataManager())
+
+
+# This should be temporary. Ideally namespaces should be cached in the NWB files
+# See https://github.com/SilverLabUCL/PySilverLabNWB/issues/26
+def init_extensions():
+
+    for namespace_file in glob.glob(EXTENSION_PATH + '/**/*.namespace.*ml'):
+        extension_path = os.path.dirname(namespace_file)
+        extension_name = os.path.basename(extension_path)
+        logging.info('Initializing extension ' + extension_name)
+        load_namespaces(namespace_file)
+
+        init_file = os.path.join(extension_path, 'init.py')
+        if os.path.exists(init_file):
+            try:
+                with open(init_file) as f:
+                    for line in f:
+                        eval(line)
+            except Exception as e:
+                logging.error("Error evaluating extension init file " + init_file, exc_info=True)
+init_extensions()