Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 5 additions & 13 deletions env.example
Original file line number Diff line number Diff line change
@@ -1,15 +1,6 @@
# This file must be copied to .env and the appropriate variables populated.


# GitHub

# https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api#primary-rate-limit-for-authenticated-users
#
# https://docs.github.com/en/rest/authentication/authenticating-to-the-rest-api

# GH_TOKEN =


## GCS (Google Custom Search)

# https://developers.google.com/custom-search/v1/introduction
Expand All @@ -31,9 +22,10 @@
# GCS_CX =


## Flickr
# GitHub

# "The flickr developer guide: https://www.flickr.com/services/developer/"
# https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api#primary-rate-limit-for-authenticated-users
#
# https://docs.github.com/en/rest/authentication/authenticating-to-the-rest-api

# FLICKR_API_KEY =
# FLICKR_API_SECRET =
# GH_TOKEN =
93 changes: 93 additions & 0 deletions pre-automation/sources.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
## Flickr

**Description:** _With over 5 billion photos (many with valuable metadata such
as tags, geolocation, and Exif data), the Flickr community creates wonderfully
rich data. The Flickr API is how you can access that data. In fact, almost all
the functionality that runs flickr.com is available through the API._ ([Flickr:
The Flickr Developer Guide](https://www.flickr.com/services/developer/))

**API documentation link:**
- [API documentation - Flickr Services](https://www.flickr.com/services/api/)

**API information:**
- API key required
- Query limit: 3600 requests per hour
- Data available through CSV format


## Internet Archive Python Interface

**Description:** A python interface to archive.org to achieve API requests
towards internet archive.

**API documentation link:**
- [internetarchive.Search - Internetarchive: A Python Interface to
archive.org][ia-search]

**API information:**
- No API key required
- No query limits

[ia-search]: https://internetarchive.readthedocs.io/en/stable/internetarchive.html#internetarchive.Search


## MediaWiki Action API

**Description:** _The MediaWiki Action API is a web service that allows access
to some wiki features like authentication, page operations, and search. It can
provide meta information about the wiki and the logged-in user._ ([API:Main
page - MediaWiki](https://www.mediawiki.org/wiki/API:Main_page))

**API documentation link:**
- [MediaWiki Action API](https://www.mediawiki.org/wiki/API:Main_page)

**API information:**
- No API key required
- Query limit: depends on user status and request type
- Data available through XML or JSON format


## The Metropolitan Museum of Art Collection API

**Description:** _The Met’s Open Access datasets are available through our API.
The API (RESTful web service in JSON format) gives access to all of The Met’s
Open Access data and to corresponding high resolution images (JPEG format) that
are in the public domain._ ([The Metropolitan Museum of Art Collection
API](https://metmuseum.github.io/))

**API documentation link:**
- [Latest Updates | The Metropolitan Museum of Art Collection
API](https://metmuseum.github.io/)

**API information:**
- No API key required
- 80 queries per second


## Vimeo API

**Description:** The Vimeo API allows users to perform filtered, advanced
search on Vimeo videos.

**API documentation link:**
- [Getting Started with the Vimeo API](https://developer.vimeo.com/api/start)

**API information:**
- API key required
- Query limit: 5000 authenticated requests per day
- Data available through JSON format


## YouTube Data API

**Description:** An API from YouTube for platform users to upload videos,
adjust video parameters, and obtain search results.

**API documentation link:**
- [Search: list | YouTube Data API | Google
Developers](https://developers.google.com/youtube/v3/docs/search/list)

**API information:**
- API key required
- Query limit: depends on the type and number of requests
- Data available through JSON format
180 changes: 0 additions & 180 deletions pre-automation/wikipedia/data_wikipedia_2022_10_24.csv

This file was deleted.

Loading