...
Spark DataFrame can be used smoothly with the intake framework. Intake makes it easy to create data catalogs from different data sources. Once the data source is defined in the catalog, it can be loaded into a Spark DataFrame using the intake API. The Spark DataFrame can then be used for data analysis and manipulation with the powerful Spark cluster.
NCI
...
data collections with Intake-spark catalogue
| Data Collections |
|---|
- 3d-geology-fj9
- access-aps2-lb4
- access-om2-cj50
- access-s2-ux62
- aerial-survey-fk2
- agcd-zv2
- anu-climate-gh70
- anu-water-ub8
- aster-p36
- aster-wx7
- aura-rq0
- aus400-ia89
- aus-elevation-rr1
- aus-hazards-fj6
- barpa-py18
- barra2-ob53
- barra-cj37
- bluelink-ocean-gb6
- bom-ocean-ref-rr6
- bom-seasonal-climate-rr8
|
...
| CMIP5/6 | Earth observation | Model/weather | Geophysics |
|---|
| ra22if87xu18access-aps2-lb4access-om2-cj50pj6cj37rt52wr45iu04rq0cj50hj10zv2qu79zz93ob53py18p36- ccam-hq89
- cmip3-cb20
- cmip5-al33
- cmip5-rr3
- cmip6-fs38
- cmip6-oi10
- cmip-forcing-qv56
- create-ip-qu79
- csiro-remote-sensing-u39
- ct-lab-tomography-fx2
- decadal-forecast-pj6
- era5-land-zz93
- era5-potential-uc16
- era5-rt52
- ereefs-fx3
- geoglam-tc43
- geophysics-iv65
- geophysics-my80
- geophysics-rr2
- gnss-geodesy-fj5
- gswa-geophysics-rl1
- high-altitude-ice-ub3
- himawari-8-ra22
- himawari-derivatives-rv74
- landsat-derivatives-jw04
- landsat-xu18
- marvl-je95
- national-water-fj8
- ops-aps3-wr45
- plant-phenomics-rq4
- qldfcp-2-ig45
- radar-archive-hj10
- seasonal-access-s1-ub7
- sentinel-2-ka08
- severe-weather-gg8
- soil-moisture-fj4
- sydney-forecast-gd8
- tern-emast-fj2
- water-outlook-iu04
|