chore: update script heuristics to find more meaningful repositories to ingest

[sjungling]

also limiting to 500 by lang/topic.

[timtebeek]

Good to see this put to more use!

[timtebeek]

Had to do a quick fix on the job that would have otherwise triggered a downstream refresh of the Jenkins jobs:
b4c6fe7
I see you've also triggered that job manually already; nice!

[sjungling]

@timtebeek oooh, so normally it'll auto-run on commit to main? but can also be manually trigged via the action in moderne-cli ?

[timtebeek]

Yup! Any changes made to repos.csv trigger a workflow that updates the Jenkins jobs; it even does a bit of foo to extract a prefix if it recognizes the commit message format:

jenkins-ingest/.github/workflows/updateJenkins.yaml

Lines 18 to 24 in b4c6fe7

	echo '${{ github.event.commits[0].message }}' > commit.txt
	COMMIT_TITLE=$(head -n 1 commit.txt)
	rm commit.txt
	ADDED_ORG=$(echo $COMMIT_TITLE| sed 's/\[Auto\] The \(.*\) GitHub organization is added\(.*\)$/\1/')
	echo $ADDED_ORG
	echo "ADDED_ORG=$ADDED_ORG" >> $GITHUB_ENV
	echo "COMMIT_TITLE=$COMMIT_TITLE" >> $GITHUB_ENV