Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: facebook group crawler #34

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

feat: facebook group crawler #34

wants to merge 3 commits into from

Conversation

Yukaii
Copy link
Owner

@Yukaii Yukaii commented Feb 15, 2023

No description provided.

@vercel
Copy link

vercel bot commented Feb 15, 2023 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated
zuzugo ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 20, 2023 at 3:05PM (UTC)

@Yukaii
Copy link
Owner Author

Yukaii commented Feb 15, 2023

呃啊...除了臺灣 IP 之外無法爬 R

這樣之後可能沒法上 Vercel 了

@moojing
Copy link
Collaborator

moojing commented Feb 15, 2023

呃啊...除了臺灣 IP 之外無法爬 R

這樣之後可能沒法上 Vercel 了

要用 VPN 裝成 台灣 IP 之類的？

@Yukaii
Copy link
Owner Author

Yukaii commented Feb 16, 2023 •
edited
Loading

Tor Proxy

docker run -it -p 8118:8118 -p 9050:9050 -d dperson/torproxy -l "TW"
curl -Lx http://localhost:8118 http://jsonip.com/
  1. 限制臺灣 IP 的話還蠻慢的，jsonip 這段要回傳 6s （不用 proxy 1s local machin)

自己在 AWS 弄一台接近 free tier 的多工用 server 來用

  • 還是有 IP 問題

自己 Host RBP 或 Nas 的 HTTP Proxy

  • IP 被祖怎麽辦

@Yukaii
Copy link
Owner Author

Yukaii commented Feb 18, 2023

GCP 或 Azure 有臺灣的機器，接下來用那邊開開看好了

@Yukaii
Copy link
Owner Author

Yukaii commented Feb 18, 2023

https://github.com/joshuatz/gcp-proxy-func

@Yukaii
Copy link
Owner Author

Yukaii commented Feb 19, 2023

用 GCP 部屬了簡單的 cloud function proxy，發現 IP 也被鎖了，沒什麼用

https://github.com/Yukaii/http-proxy-cloud-function

@Yukaii Yukaii linked an issue Feb 21, 2023 that may be closed by this pull request
臉書社團資料來源 #24
Open
@Yukaii
Copy link
Owner Author

Yukaii commented Feb 21, 2023

難道就要這麼放置了嗎？XDrz 好可惜

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
Zuzugo Project board
Status: In Progress
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

臉書社團資料來源
2 participants
@Yukaii @moojing