An alternative to APIs, Scrape Up is a Python package for web scraping. It allows you to extract data from platforms like GitHub, Twitter, Instagram, or any other website that contains valuable information. It enables you to gather data through programming.
Terms and conditions for use, reproduction, and distribution are under the MIT License.
CODE PEAK is a month-long program that helps students understand the paradigm of Open Source contribution and gives them real-world software development experience. The event targets first-timers who wish to participate in Free and Open Source(FOSS) Contributions and the experienced developers who want to show their skills by contributing to real-world projects.
Learn more about it here
- Flexible Scraping: Customize and define the specific data you want to extract from different platforms.
- Easy-to-Use: Intuitive Python package interface for both beginners and experienced developers.
- Multiple Platforms: Scrape data from various platforms, including GitHub, Twitter, Instagram, and more.
- Efficient and Fast: Designed for efficient and reliable scraping of data from multiple sources.
- Install the package using
pip:
pip install scrape-up --upgrade- Import the required module and instantiate an object with the necessary parameters:
# Import the required module
from scrape_up import github
# Instantiate an object with the username
user = github.Users(username="nikhil25803")- Call the desired method to scrape the required information. For example, to extract the number of followers of a user:
# Call the followers method
followers_count = user.followers()
# Print the output
print(followers_count)Output:
83
- Explore all the available methods provided by Scrape Up on different platforms here.
Happy scrapping! 🕸️
In our project journey, we encountered several challenges, including requesting timeouts and rate limits. To overcome these limitations, we developed a powerful Python tool based on web scraping. Our goal is to provide an alternative to APIs for extracting data from various platforms, including GitHub, Twitter, Instagram, and any other website that contains valuable information. Here's what our project aims to achieve:
With our web-scraping-based Python tool, you can unlock a world of data and overcome the limitations often encountered when relying solely on APIs.
🌟 We value the time and effort you put into contributing, and we look forward to reviewing and merging your contributions. Together, let's make web scraping a powerful and accessible tool for extracting data from various platforms.
✨ Thank you for your contribution!