Home

OCTRON is a pipeline built on napari that enables segmentation and tracking of animals in behavioral setups. It helps you to create rich annotation data that can be used to train your own machine learning segmentation models. This enables dense quantification of animal behavior across a wide range of species and video recording conditions.

OCTRON is built on Napari, Segment Anything (SAM2), YOLO, BoxMOT and 💜.

The main steps implemented in OCTRON typically include: Loading video data from behavioral experiments, annotating frames to create training data for segmentation, training machine learning models for segmentation and tracking, and finally applying models to new data for automated tracking.

How to cite

Using OCTRON for your project? Please cite this paper to share the word!
👉Add paper details

---

Attributions

• Interface button and icon images were created by user Arkinasi from Noun Project (CC BY 3.0)
• Logo font: datalegreya
• OCTRON mp4 video reading is based on napari-pyav
• OCTRON training is accomplished via ultralytics:

  @software{yolo11_ultralytics,
    author = {Glenn Jocher and Jing Qiu},
    title = {Ultralytics YOLO11},
    version = {11.0.0},
    year = {2024},
    url = {https://github.com/ultralytics/ultralytics},
    orcid = {0000-0001-5950-6979, 0000-0002-7603-6750, 0000-0003-3783-7069},
    license = {AGPL-3.0}
  }
  

• OCTRON annotation data is generated via Segment Anything:

  @article{kirillov2023segany,
    title={Segment Anything},
    author={Kirillov, Alexander and Mintun, Eric and Ravi, Nikhila and Mao, Hanzi and Rolland, Chloe and Gustafson, Laura and Xiao, Tete and Whitehead, Spencer and Berg, Alexander C. and Lo, Wan-Yen and Doll{\'a}r, Piotr and Girshick, Ross},
    journal={arXiv:2304.02643},
    year={2023}
  }
  

  @inproceedings{sam_hq,
      title={Segment Anything in High Quality},
      author={Ke, Lei and Ye, Mingqiao and Danelljan, Martin and Liu, Yifan and Tai, Yu-Wing and Tang, Chi-Keung and Yu, Fisher},
      booktitle={NeurIPS},
      year={2023}
  }  
  

• OCTRON multi-object tracking is achieved via BoxMot trackers:

  cff-version: 15.0.2
  preferred-citation:
    type: software
    authors:
      - family-names: Broström
        given-names: Mikel
    title: "BoxMOT: pluggable SOTA tracking modules..."
    version: 15.0.2