CommonDataModel.jl

CommonDataModel.jl is a module that defines types common to NetCDF and GRIB data
Author JuliaGeo
Popularity
5 Stars
Updated Last
1 Year Ago
Started In
March 2023

Build Status codecov.io documentation dev

This package contains abstracts type definition to ensure compatibility of the package GRIBDatasets and NCDatasets for manipulating GRIB and NetCDF files. This package aims to follow the Common Data Model and the CF (climate and forecast models) Metadata Conventions.

This package is at a very early state of developpement.

Here is minimal example for loading GRIB or NetCDF files.

import CommonDataModel as CDM
import SomeDatasets # where SomeDatasets is either GRIBDatasets or NCDatasets

ds = SomeDatasets.Dataset("file_name")

# ntime is the number of time instances
ntime = CDM.dims(ds)["time"]

# create an array-like structure v corresponding to variable temperature
v = ds["temperature"]

# load a subset
subdata = v[10:30,30:5:end]

# load all data
data = v[:,:]

# load a global attribute
title = CDM.attribs(ds)["title"]
close(ds)

Most users would typically import GRIBDatasets and NCDatasets directly and not CommonDataModel. One should import CommonDataModel only to extent the functionality of GRIBDatasets and NCDatasets.

As a proof-of-concept, there is also an TIFFDatasets package for GeoTIFF files.

File conversions

By implementing a common interface, GRIB files can be converted to NetCDF files using NCDatasets.write:

using NCDatasets
using GRIBDatasets
using Downloads: download

grib_file = download("https://github.com/JuliaGeo/GRIBDatasets.jl/raw/98356af026ea39a5ec0b5e64e4289105492321f8/test/sample-data/era5-levels-members.grib")
netcdf_file = "test.nc"
NCDatasets.write(netcdf_file,GRIBDataset(grib_file))