Migration to AWS Data Source

Open Learning Engineering provides JSON data from s3. The data are more complete and allow us to get closer to replicating OCW in out beta testing.

This code still allows a user to import OCW content into Contentful. However, one needs s3 credentials in order to so. There is no timeline for allowing others to get these credentials, but it should be possible in the not to distant future.

OCW to Contentful via JSON data from OCW

OCW provides courseware data in a JSON format organized by department. Each department has a list of courses with metadata and file links nested by type. In order to get to a single course, we load the department data, then access a single course (ocw uids are keys) or loop through courses. Department URL example: https://ocw.mit.edu/courses/biology/biology.json

This code version provides methods to import these OCW data into Contentful.