Data Collection and Processing with Python

Data Collection and Processing with Python

This course is part of Python 3 Programming Specialization

Instructor: Paul Resnick

114,420 already enrolled

Included with

Learn more

4 modules

Gain insight into a topic and learn the fundamentals.

4,052 reviews

Intermediate level

Some related experience required

Flexible schedule

2 weeks at 10 hours a week

Learn at your own pace

97%

Most learners liked this course

4 modules

Gain insight into a topic and learn the fundamentals.

4,052 reviews

Intermediate level

Some related experience required

Flexible schedule

2 weeks at 10 hours a week

Learn at your own pace

97%

Most learners liked this course

What you'll learn

Fetch and process data from Internet services effectively.
Master Python list comprehensions for data extraction and processing.
Utilize the Python requests module to interact with REST APIs and navigate API documentation.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

2 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Python 3 Programming Specialization

When you enroll in this course, you'll also be enrolled in this Specialization.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 4 modules in this course

This course teaches you to fetch and process data from services on the Internet. It covers Python list comprehensions and provides opportunities to practice extracting from and processing deeply nested data. You'll also learn how to use the Python requests module to interact with REST APIs and what to look for in documentation of those APIs. For the final project, you will construct a “tag recommender” for the flickr photo sharing site.

The course is well-suited for you if you have already taken the "Python Basics" and "Python Functions, Files, and Dictionaries" courses (courses 1 and 2 of the Python 3 Programming Specialization). If you are already familiar with Python fundamentals but want practice at retrieving and processing complex nested data from Internet services, you can also benefit from this course without taking the previous two. This is the third of five courses in the Python 3 Programming Specialization.

What's included

5 videos3 readings1 ungraded lab

5 videosTotal 41 minutes

Introduction to the Specialization11 minutes
What’s New? Updates and Improvements in the Second Edition2 minutes
Welcome to Python Data Collection and Processing with Python2 minutes
(Optional) How to Use the Interactive Textbook14 minutes
Executing Python in the Jupyter Environment11 minutes

3 readingsTotal 30 minutes

Syllabus10 minutes
A note to learners who have not taken the updated course 2 - Functions, Files and Dictionaries10 minutes
Help Us Learn More About You!10 minutes

1 ungraded labTotal 60 minutes

(Optional) Getting Started with Jupyter Notebooks60 minutes

In week one the video lectures and activities from the Runestone textbook will cover more complex data structures. By the end of this week, you will have learned how to process json formatted data, traverse nested data using nested iteration, and extract values from nested data.

What's included

13 videos1 assignment1 programming assignment8 app items1 ungraded lab

13 videosTotal 102 minutes

Introduction - Nested Data1 minute
Nested Lists17 minutes
Nested Dictionaries7 minutes
JSON Format and the JSON Module7 minutes
Conclusion - Nested Data2 minutes
Introduction - Nested Iteration2 minutes
Nested Iteration19 minutes
Structuring Nested Data6 minutes
Shallow Copies7 minutes
Deep Copies10 minutes
Extracting from Nested Data14 minutes
A Worked Example of Nested Iteration7 minutes
Conclusion: Nested Data and Nested Iteration2 minutes

1 assignmentTotal 4 minutes

Optional - What Did You Use to Practice This Week?4 minutes

1 programming assignmentTotal 60 minutes

Assessment - Nested Data and Nested Iteration60 minutes

8 app itemsTotal 75 minutes

Use the Runestone Practice Tool5 minutes
Introduction: Nested Data and Nested Iteration10 minutes
Nested Dictionaries10 minutes
Processing JSON Results10 minutes
Nested Iteration10 minutes
Structuring Nested Data10 minutes
Deep and Shallow Copies10 minutes
Extracting from Nested Data10 minutes

1 ungraded labTotal 60 minutes

(Optional) JavaScript Object Notation (JSON)60 minutes

In week two you will be learning more advanced forms of accumulation. By the end of the week, you will have learned how to use the map and filter functions in combination with functions to transform or filter out data and store the resulting data in a new object. You will have also learned how to accumulate data using a list comprehension.

What's included

13 videos1 assignment1 programming assignment6 app items3 ungraded labs

13 videosTotal 78 minutes

Introduction - Map and Filter1 minute
Map14 minutes
Filter8 minutes
Conclusion - Map and Filter3 minutes
Introduction - List Comprehensions1 minute
List Comprehensions9 minutes
List Comprehensions Example 17 minutes
List Comprehensions Example 210 minutes
Conclusion - List Comprehensions1 minute
Introduction - Zip1 minute
Zip8 minutes
An Example Using Zip13 minutes
Conclusion - Zip1 minute

1 assignmentTotal 4 minutes

Optional - What Did You Use to Practice This Week?4 minutes

1 programming assignmentTotal 60 minutes

Assessment - More on Accumulation60 minutes

6 app itemsTotal 55 minutes

Use the Runestone Practice Tool5 minutes
Introduction: Map, Filter, List Comprehensions, and Zip10 minutes
Map10 minutes
Filter10 minutes
List Comprehensions10 minutes
Zip10 minutes

3 ungraded labsTotal 180 minutes

(Optional) Map and Filter60 minutes
An Example Using Zip60 minutes
(Optional) Review and List Comprehensions Warmup60 minutes

In week three you will learn how to request data from the internet using Application Programming Interfaces (APIs). By the end of the week, you will have learned how to access data from a few APIs, cache data that you have requested, and also learned how to read and work with other APIs that were not touched on in the module.

What's included

25 videos2 readings1 programming assignment12 app items2 ungraded labs

25 videosTotal 132 minutes

Introduction - REST APIs2 minutes
URLs, Domain Names, and IP Addresses5 minutes
Routing4 minutes
HTTP: Behind the Scenes6 minutes
URL Query Parameters3 minutes
REST API URLs3 minutes
The requests Module6 minutes
Generating URLs with requests.get6 minutes
Conclusion - REST APIs2 minutes
Introduction - Using REST APIs1 minute
Reading API Documentation: Datamuse8 minutes
Debugging Calls to requests.get6 minutes
Caching Response Content8 minutes
The requests_with_caching Module9 minutes
Conclusion - Using REST APIs2 minutes
Introduction - Practice with REST APIs1 minute
iTunes API8 minutes
flickr API15 minutes
Conclusion - Practice with REST APIs1 minute
Fun with the Google Places API20 minutes
Running Python in Hosted Systems2 minutes
Creating Your Own API - Part 12 minutes
Creating Your Own API - Part 25 minutes
Creating Your Own API - Part 35 minutes
Introduction - Final Course Project2 minutes

2 readingsTotal 20 minutes

Course Feedback10 minutes
Keep Learning with Michigan Online10 minutes

1 programming assignmentTotal 60 minutes

Project - OMDB and Dad Joke Mashup60 minutes

12 app itemsTotal 115 minutes

Use the Runestone Practice Tool5 minutes
The Internet: Behind the Scenes10 minutes
Anatomy of URLs10 minutes
The HTTP Protocol10 minutes
Using REST APIs10 minutes
Fetching a Page10 minutes
Figuring Out How to Use a REST API10 minutes
Debugging Calls to requests.get10 minutes
Caching Response Content10 minutes
Searching for Media on iTunes10 minutes
Searching for tags on Flickr10 minutes
Unicode for Non-English Characters10 minutes

2 ungraded labsTotal 120 minutes

(Optional) REST APIs60 minutes
(Optional) Request Data with Cache60 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Instructor ratings

(515 ratings)

Paul Resnick

University of Michigan

13 Courses600,226 learners

Offered by

University of Michigan

Explore more from Software Development

Status: Preview
Nanjing University
Data Processing Using Python
Course
Status: Free Trial
University of Michigan
Using Python to Access Web Data
Course
Status: Free Trial
Google
Introduction to Data Analysis Using Python
Course
Status: Free Trial
University of Michigan
Python Functions, Files, and Dictionaries
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

5 stars
77.02%
4 stars
17.49%
3 stars
3.94%
2 stars
0.64%
1 star
0.88%

Showing 3 of 4052

Reviewed on Aug 9, 2020

Great course for nested data analysis, list comprehension and introduces one into the world of APIs. Lots to learn with special treats in the form of Dr. Resnick's dad jokes (pun intended).

Reviewed on Feb 10, 2020

Excellent understunding of programming. Advanced concepts such list comprenhension, map and zip make me review my way of thinking, producing better and shorten coding.Thxs to the Instructors.

Reviewed on May 16, 2020

I thoroughly enjoyed this course, and found myself often looking forward to Prof. Resnick's jokes. I also came to see the beauty and simplicity of Python. Great course. Great language.

View more reviews

Unlock access to 10,000+ courses with a subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 4,700 global companies that choose Coursera for Business

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.