Skip to content

Commit 23e541f

Browse files
authored
Merge pull request #279 from creativecommons/arxiv-fetch
Update arXiv fetch
2 parents 0ad1d6c + 8ada4d1 commit 23e541f

File tree

11 files changed

+839
-689
lines changed

11 files changed

+839
-689
lines changed

Pipfile.lock

Lines changed: 379 additions & 193 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

scripts/1-fetch/arxiv_fetch.py

Lines changed: 438 additions & 487 deletions
Large diffs are not rendered by default.

scripts/1-fetch/gcs_fetch.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,7 @@
22
"""
33
Fetch CC Legal Tool usage data from Google Custom Search (GCS) API.
44
"""
5+
56
# Standard library
67
import argparse
78
import csv

scripts/2-process/gcs_process.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,7 @@
22
"""
33
Process Google Custom Search (GCS) data.
44
"""
5+
56
# Standard library
67
import argparse
78
import os

scripts/2-process/github_process.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
This file is dedicated to processing GitHub data
44
for analysis and comparison between quarters.
55
"""
6+
67
# Standard library
78
import argparse
89
import os

scripts/2-process/wikipedia_process.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
This file is dedicated to processing Wikipedia data
44
for analysis and comparison between quarters.
55
"""
6+
67
# Standard library
78
import argparse
89
import os

scripts/3-report/gcs_report.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
This file is dedicated to visualizing and analyzing the data collected
44
from Google Custom Search (GCS).
55
"""
6+
67
# Standard library
78
import argparse
89
import os

scripts/3-report/github_report.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
This file is dedicated to visualizing and analyzing the data collected
44
from GitHub.
55
"""
6+
67
# Standard library
78
import argparse
89
import os

scripts/3-report/wikipedia_report.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
This file is dedicated to visualizing and analyzing the data collected
44
from Wikipedia.
55
"""
6+
67
# Standard library
78
import argparse
89
import os

scripts/3-report/zzz-notes.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,7 @@
22
"""
33
Add project references.
44
"""
5+
56
# Standard library
67
import argparse
78
import os

0 commit comments

Comments
 (0)