Repository Software

The flattenedFauna Repository uses CKAN (Comprehensive Knowledge Archive Network), an open source, free data management software that requires little development overhead and is well supported. Many civic data repositories use CKAN. This was an important consideration because a significant portion of datasets within flattenedFauna are sourced from civic bodies. CKAN allows for customized metadata, includes data preview and visualization extensions, and offers a strong search engine.

CKAN also provides users across all communities to engage with each other, contributors, and administrative staff through comment features.

Repository Features

Some of the CKAN features and extensions that we are utilizing to offer the repository functionality desired by our users are described below.

Filestore and the ckanext-cloudstorageplugin

Filestore allows users to upload and store data in the Repository. The ckanext-cloudstorage extension facilitates cloud storage provided by Amazon Web Services (AWS) Elastic Compute Cloud (EC2).

DataStore and API

While FileStore allows users to upload datasets, users can't preview datasets before download. By extending our CKAN repository with DataStore, users are able to view and evaluate resources via the web interface. The DataStore API allows CKAN resources to be searched and filtered also without downloading an entire dataset.

DataPusher

Automatically parses and includes data into the DataStore in the correct format.

DataExplorer

This extension is designed to display, query, filter, graph, and map structured data stored in DataStore. DataExplorer also allows users to view automatic previews on the resource page.

Because CKAN is open source and in widespread use, it has longevity and developers will continue to add new features to ameliorate data management, curation, and sharing.