The Hong Kong University of Science and TechnologyMarine AI · Robotics · Ocean Science · Nature-based Solutions
CMI / Center for Marine Intelligence海洋智能中心 · HKUST
HomeResources

RESOURCES 01

Datasets

Open datasets and benchmarks for coral reefs and marine life. Each one links to its project page with the paper, download and citation.

Coral AI4 datasets · 2023–2026

Top-down quadrat photo of a dense coral reef patch

International Coral Reef Symposium (ICRS) 2026

Oral · 15 min

Dense-CoralNet

Large-scale coral reef imagery with dense semantic labels

Browse coral reef survey images online and open any one in the semantic segmentation viewer to inspect its dense labels.

Images
272,690
  • Semantic segmentation
  • Online browser
Browse Dense-CoralNet
CoralSCOP teaser figure showing coral segmentation results across many reef images

CVPR 2024

Highlight

CoralSCOP

Segment any COral Image on this Planet

The first foundation model for dense coral reef segmentation. It outlines individual corals at several levels of detail, from coral versus non-coral to growth form and genus, and powers the CoralSCOP-LAT tool.

Training masks
1.3M
Levels of detail
3
  • Foundation model
  • Coral segmentation
Visit CoralSCOP
HKCoral title over an underwater coral reef scene

IEEE Journal of Oceanic Engineering 2024

HKCoral

Benchmark for Dense Coral Growth Form Segmentation in the Wild

Coral images taken in real Hong Kong conditions: low visibility, motion blur, clutter and colour distortion. Every pixel is labelled by coral growth form, which helps models generalise to reefs they have not seen.

Images
2,515
Growth forms
6
Methods benchmarked
17
  • Semantic segmentation
  • In-the-wild
Visit HKCoral
CoralVOS title over a grid of video frames with coral masks in red

arXiv 2023

CoralVOS

Dataset and Benchmark for Coral Video Segmentation

The first dataset for dense coral video segmentation. Segmenting every frame, rather than sampling points, gives more reliable coral coverage estimates and better 3D reef reconstruction.

VOS methods benchmarked
6
  • Video object segmentation
  • 3D reconstruction
Visit CoralVOS

Marine AI7 datasets · 2023–2027

MarineLife-16K overview: marine video clips with motion, multi-object and other questions, organised into a dataset and a benchmark

WACV 2027

MarineLife-16K

An Attribute-Rich Video-Text Dataset for Motion-Aware Marine Video Understanding

Marine videos annotated with fine-grained attributes (appearance, motion, environment, lighting and camera viewpoint), captions and question-answer pairs, for testing how well vision-language models understand marine video.

Videos
2,000
Video QA pairs
16,080
  • Video question answering
  • Video captioning
  • VLM benchmark
Visit MarineLife-16K
MarineEVT overview figure with reasoning dimensions and the EVT-R1 tool-reasoning loop

ECCV 2026

MarineEVT

Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning

Underwater video events are sparse, brief and unevenly spread. MarineEVT annotates them as question-answer pairs covering semantic, contextual, spatial, temporal and causal reasoning, with the EVT-R1 tool-reasoning baseline.

Video QA pairs
20K
Dimensions
20
  • Video question answering
  • Event reasoning
Visit MarineEVT
ORCA title image: a breaching orca made from a mosaic of marine species photos

WACV 2026

Oral

ORCA

Object Recognition and Comprehension for Archiving Marine Species

A species-level benchmark that pairs bounding boxes with instance-level, expert-verified captions for detection, image grounding and captioning of marine life.

Images
14,647
Species
478
Boxes
42,217
  • Detection
  • Grounding
  • Captioning
Visit ORCA
Coral reef with a sea turtle, manta ray and reef fish

WACV 2026

Oral

MarineEval

Assessing the Marine Intelligence of Vision-Language Models

A visual question-answering benchmark that tests whether general vision-language models handle marine tasks, from species identification to conservation knowledge. Results are reported for 17 open and closed-source models.

Questions
2,000
Dimensions
7
Sub-dimensions
20
  • Visual question answering
  • VLM benchmark
Visit MarineEval
MSC annotation pipeline: manual mask annotations, video splitting, synthetic clip captions and expert captions

ACM Multimedia 2025 · Datasets

MSC

A Marine Wildlife Video Dataset with Grounded Segmentation and Clip-Level Captioning

Marine wildlife videos annotated as video, caption and segmentation-mask triplets for visual grounding, captioning and video generation. Splitting videos at scene changes captures more of what each clip shows.

  • Video captioning
  • Grounded segmentation
  • Sample set released Apr 2026
Visit MSC
MarineInst teaser figure showing instance masks and captions for many downstream marine tasks

ECCV 2024

Oral

MarineInst

A Foundation Model for Marine Image Analysis with Instance Visual Description

A marine foundation model that outputs an instance mask and a caption for each object, trained on MarineInst20M, the largest marine image dataset to date.

Images
2.42M
Instance masks
19.2M
  • Foundation model
  • Instance segmentation
  • Captioning
Visit MarineInst
Grid of Marine Video Kit frames from dive sites, each with an automatic caption

MMM 2023

Oral

MVK

Marine Video Kit: A New Marine Video Dataset for Content-Based Analysis and Retrieval

Single-shot underwater videos from moving cameras, with metadata and keyframe descriptions for video retrieval. Used in a special session of the Video Browser Showdown 2023.

Videos
1,379
Footage
12+ h
Countries & regions
11
  • Video retrieval
  • Known-item search
Visit MVK