Data-like File Formats: CSV and floating point GeoTIFFs

In addition to the standard file formats that we support in NEO—JPEG, PNG, GeoTIFF, and GoogleEarth—many (not all) datasets support two additional “data-like” formats: CSV (comma-separated values) and floating point GeoTIFF. When you choose one of these formats for download, there are a few details that should be taken into consideration.

  • The values that these files contain have been scaled and resampled for visualization purposes in NEO and should not be considered for rigorous scientific examination. At best they are useful for basic analysis and trend detection but if you are interested in conducting research-level science we recommend that you use the original source data (which are not hosted by NEO, but we can assist you in identifying the source).
  • CSV files can get quite large at full resolution. For example, a 3600×1800 CSV file can get to around 61MB. If your software has difficulty opening a file of that size then please select a smaller resolution (e.g., 1440×720).
  • There are two flavors of CSV available in NEO:
    1. “Regular” CSV which includes the text-only values at the resolution the user specifies. This format is suitable for Excel (2007 and later) and many other applications.
    2. “CSV for Excel” In Excel versions prior to 2007, worksheets could not support more than 256 columns. To remedy this, this format option is resized to 250×125. The first row contains the longitude values for the center of the cell and the first column contains the latitudes.
  • Floating point GeoTIFFs contain 32-bit numerical data along with the geolocation information that is standard for the Geo format. These files can also get large as they are not internally compressed—e.g., a 3600×1800 GeoTIFF can be around 25MB.

These formats are not available by default in our archive but if you are interested in obtaining a long time series of a dataset in one of these formats, please contact us and we can perform a customized export to the ftp site in the format you need.

52 responses to “Data-like File Formats: CSV and floating point GeoTIFFs”

  1. Hi,

    I am interested in monthly data for Afghanistan in 2009 (Jan-Dec) but there is no way to download the data for the selected area (38.5N, 29.4S, 60.4W, 75E).

    Please could you help me with GeoTIFF image of Land Surface Temperature, Vegetation and Total Rainfall for Afghanistan (38.5N, 29.4S, 60.4W, 75E).

    Thanking you in anticipation for your kind gesture.

    Sincerely,
    Oyelola

  2. Hello:
    I appreciate your efforts on making science data available. I would like to do some scientific research at the Peruvian Andes (0-20S latitude and 62-82W longitude), so I would like to use the MODIS (1km or 5km) water vapor data for the period 1998-2013 if possible. I hope you could help me to find that data.
    Thanks
    Steven

  3. Kevin Ward says:

    Hello Steven,

    First, the MODIS data record only goes back to 2000 (Terra launched in 1999 and Aqua in 2002).

    Second, two places you should investigate for data:

    + http://ladsweb.nascom.nasa.gov/data/search.html – You will want to select either Terra or Aqua MODIS and then the “Atmosphere Level 3” group and then the products you want. You can do some subsetting in the form below to retrieve only a specific region. It’s not the prettiest interface but depending on your data expertise you can get what you want.

    + http://gdata1.sci.gsfc.nasa.gov/daac-bin/G3/gui.cgi?instance_id=MODIS_MONTHLY_L3 – A slightly better interface with more capabilities to plotting time series and performing analysis within the browser. The downside is that they only have 1×1 degree holdings (the ladsweb above has full resolution).

  4. Kevin Ward says:

    Hello Oyelola,

    That is correct — NEO does not provide the ability to subset GeoTIFF images. You will need to download the full resolution and select the region from the global images.

  5. J. Albert Bowden II says:

    love the effort everyone!
    while you are at it, please provide .json -> provide everything in .json.
    also, once thats done, its quite minor to convert .json -> .geojson/.topojson 😉
    .json ALL THE THINGS

  6. JAY SHETH says:

    I am in my final year Computer Engineering. My final year project is Parallel Computing in Data Mining algorithms. My group is implementing an algorithm named Peano Count Tree Association Rule Mining(PARM). And in this algorithm we need Rainfall and agricultural/vegetation patern data of India. Lots of images are needed.
    Images are needed in BSQ format. Jpeg will also do. But first preference is BSQ format

  7. kashif majeed says:

    How can I extract AOD fof modis data (GeoTiff Format) in ArcGIS

  8. Julia Thompson says:

    Hi, Having opened a CSV download file for SST is there an associated ‘read me’ file with data layout (in terms of which cell corresponds to which latitude and longitude?)

    Thanks,
    Julia

  9. Kevin Ward says:

    Hello Julia,

    The plainly-labeled “CSV” files do not have any geolocation information within them, but the “CSV for Excel” variety do. Also, since every file is global (360×180 degrees) you can divide the degrees by the dimensions of the file to determine the size of the cell in degrees.

  10. Janah says:

    Hi,

    I have downloaded some GEOTIFFS and tried them on QGIS. It seems that the values are too low to be in Celsius. The location I am gathering data from has a very temperate climate. I was wondering if it is truly in Celsius. If not, what unit are you using?

    Thank you.

  11. Kevin Ward says:

    It is likely that you downloaded the 8-bit raster map GeoTIFF when you really want the floating point GeoTIFF which includes values, which is another option in the data format pull down.

  12. Ismael says:

    Hi guys
    I want to download chlorophyll data for oceans from the period of 2005 to 2008.
    I realized I can download the tiffs monthly, was wondering on how I can combine this monthly data into seasonal ones? Like is it possible to get tiffs for a couple of months combined than just getting it monthly.
    Like is there a possibility of getting a tiff file for 2007 for months April, may, June and July combined?

    Looking forward to your reponse.
    regards
    Ismael

  13. Lingcai Kong says:

    Hi,

    We appreciate your effort on the data. We are interested in the monthly land surface temperature [day] and [night] for the period 2000-2017, in the format “3600×1800 floating point GeoTIFFs ” . Would it convenient for you to provide us an export to download the long series of dataset?

    Thank you!

  14. Baris Isik says:

    Hello,

    Firstly I think there is one day difference between the one we have chosen from calendar and the real date value that is taken from system which can be seen on XHR tab in getDate.php.
    But my main issue is following. I want to scrape daily AOD data for 3-4 years with R, so I need to reach the URL of these daily CSVs for this. But I couldnt manage to handle date information. For example “https://neo.gsfc.nasa.gov/servlet/RenderData?si=1712894&cs=rgb&format=CSV&width=360&height=180”
    is url for aqua/modis Feb 24th 2017 360×180 csv (although I chose 25th). When I change the date si=1712894 part of url changes but I could not able to find the pattern. Would you please help me with this ?

    Thanks in advance

  15. Kevin Ward says:

    Hello Lingcai,

    Those files can be downloaded in bulk from our ftp server:

    ftp://neoftp.sci.gsfc.nasa.gov/geotiff.float/MOD11C1_M_LSTDA/
    ftp://neoftp.sci.gsfc.nasa.gov/geotiff.float/MOD11C1_M_LSTNI/

    Please be aware of the caveats involved with using these files for research purposes: http://neo.sci.gsfc.nasa.gov/blog/2013/12/23/csv-and-floating-point-geotiffs/

  16. Kevin Ward says:

    Hello Ismael,

    NEO does not provide any additional functionality for compositing images (e.g., averaging for climatologies). However, there are two other options:

    + You may download seasonal chlorophyll composites or climatologies from the original data provider (NASA Oceancolor Group):

  17. Douglas AMULI says:

    Hello dear Kevin,

    I appreciate a lot your effort on the data.
    I’m conducting a scientific research and would like to get data on annual night light intensity For developing countries.
    From 1995 or before to 2015 or after.

    Can I get such data and how ?

    I’ll more appreciate if I can get the link for the Map where data has been constructed so that I can replicate the construction myself

    Thanks a lot in advance for your reply.

  18. Marcos Silva says:

    Hello
    I would like to do some scientific research at the Brazilian coast, so I would like to use the MODIS sea surface temperature 2013-2017, or the MWOI SST during the same period. Where can I find rigorous research level data for these parameters?
    Thanks
    Marcos

  19. Kevin Ward says:

    Marcos,

    For MODIS/Aqua SST, you can download the source data from https://oceancolor.gsfc.nasa.gov/cgi/l3?per=MO&prd=CHL_chlor_a.nc&sen=A&res=9km&num=24&ctg=Standard&date=1Aug2017 These are global data so you will need to subset them to your region of interest.

    In addition, you might also look at NASA Giovanni, which is an online data analysis system that works with the research quality data without you needing to download it all. You can perform subsetting, averaging, and other composition functions in your browser. Probably a good option for your need: https://giovanni.gsfc.nasa.gov/giovanni/

  20. Kevin Ward says:

    Hello Baris,

    You can download all of the daily AOD imagery as floating point GeoTIFF from our ftp site:

    ftp://neoftp.sci.gsfc.nasa.gov/geotiff.float/MYDAL2_D_AER_OD/ (MODIS/Aqua)
    ftp://neoftp.sci.gsfc.nasa.gov/geotiff.float/MODAL2_D_AER_OD/ (MODIS/Terra)

Leave a Reply

Your email address will not be published.

Contact Us

Need to get a hold of someone at NEO? Just fill out the form below.





Trouble with this form? Submit your comment here.