Initial setup with private git fails for an unclear reason

[jimsnab]

I'm building my first setup flux2 to get to know it. I am setting it up with a self-hosted git server, which has a scratch project 'hello'.

sudo -u flux flux bootstrap git --branch main --ca-file /usr/local/share/ca-certificates/kube-master.cluster.dev.crt --cluster-domain cluster.dev --private-key-file /home/flux/.ssh/id_rsa --url ssh://git@kube-master.cluster.dev:/git/hello.git

It gets to this line and fails.

◎ waiting for Kustomization "flux-system/flux-system" to be reconciled
✗ context deadline exceeded

What is it trying to tell me?

The full output is:

sudo -u flux flux bootstrap git --branch main --ca-file /usr/local/share/ca-certificates/kube-master.cluster.dev.crt --cluster-domain cluster.dev --private-key-file /home/flux/.ssh/id_rsa --url ssh://git@kube-master.cluster.dev:/git/hello.git
► cloning branch "main" from Git repository "ssh://git@kube-master.cluster.dev:/git/hello.git"
✔ cloned repository
► generating component manifests
✔ generated component manifests
✔ component manifests are up to date
► installing components in "flux-system" namespace
✔ installed components
✔ reconciled components
► determining if source secret "flux-system/flux-system" exists
► generating source secret
✔ public key: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSRll6cxOp/z1D4g4U6B+Rrv39mdz7A1xV1ujRWltNIeQfob+1h0OiZXyyW2UWo2m/NRDrDdHAPT2qz1aac1xb23p2mx3RftxnK0ivHsveYw7f/jhXD6lcS/V8CgCs1j65qehIEppDlY6/o9t8sWwSxrYYLMecXpz0RX11NEJ/Qoz9zDX66Ox9Va0WWoyuC/eFqqkhVpXe3DeJdCMaHp1bes++/wzVfi9Nli5LnThtzAFT7+oYg4gzmhWPxG4WKVnYs54pSH1fj4iKbtROco6klregboI6yLnSIPgdAH3G7o/tbqgC94aaCjUPGH1ffIbKCMeyCipaD2omOQ/qmwk/o1OmAG3MvG5ERJVaLaGZCGBKcPXlL8mVOu1yI4O+79TjivW4RGCqRqJBy6xYQez9XXlmhLYLumJA539r9d6Dl+f2BF75osKlDSOCqbuWFS0ln2CLRI1DvRClhjaIvs7UTCJ3/Vwo3hNzwDhD3esJ2UAm7VdBVVwrXkE+lK6SxbM=
Please give the key access to your repository: y█
► applying source secret "flux-system/flux-system"
✔ reconciled source secret
► generating sync manifests
✔ generated sync manifests
✔ sync manifests are up to date
► applying sync manifests
✔ reconciled sync configuration
◎ waiting for Kustomization "flux-system/flux-system" to be reconciled
✗ context deadline exceeded
► confirming components are healthy
✔ source-controller: deployment ready
✔ kustomize-controller: deployment ready
✔ helm-controller: deployment ready
✔ notification-controller: deployment ready
✔ all components are healthy
✗ bootstrap failed with 1 health check failure(s)

[stefanprodan]

To debug run:

flux get sources all
flux get kustomizations

PS. --ca-file /usr/local/share/ca-certificates/kube-master.cluster.dev.crt doesn't make sense to me, that flag is for Git over HTTPS.

[jimsnab]

Excellent thanks. Self-signed is exactly the issue. My git server is outside of the cluster, but my setup is for education and thus the git server uses a self-signed cert.

[stefanprodan]

You could setup GitLab/Gitea/Gogs, all of them support Git over HTTPS, you would generate a cert and CA, then bootstrap with:

flux bootstrap git --url=https://my.git.server/repo --ca-file=path/to/ca --username --password --token-auth

More about Git over HTTPs here: https://toolkit.fluxcd.io/guides/installation/#generic-git-server

[jimsnab]

I understand - but code I ultimately want to work with will be too sensitive to go off prem. I'll look into enabling https on my private git server.

[jimsnab]

My ssh key seems to work

flux get sources all
NAME                     	READY	MESSAGE                                                        	REVISION                                     	SUSPENDED 
gitrepository/flux-system	True 	Fetched revision: main/faa0fb4e63b54d3debc0e965632148785371a9ce	main/faa0fb4e63b54d3debc0e965632148785371a9ce	False    	

but it's stuck at a concept I don't yet understand

flux get kustomizations
NAME       	READY  	MESSAGE                   	REVISION	SUSPENDED 
flux-system	Unknown	reconciliation in progress	        	False  

I suspect I need to do something in my hello project. I'm now looking for those details.

[jimsnab]

I renamed 'hello' directory holding its kubernetes yaml to flux-system, and got

sudo -u flux flux bootstrap git --branch main --private-key-file /home/flux/.ssh/id_rsa --url ssh://git@kube-master.cluster.dev:/git/hello.git
► cloning branch "main" from Git repository "ssh://git@kube-master.cluster.dev:/git/hello.git"
✔ cloned repository
► generating component manifests
✔ generated component manifests
✔ component manifests are up to date
✔ reconciled components
► determining if source secret "flux-system/flux-system" exists
► generating source secret
✔ public key: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSRll6cxOp/z1D4g4U6B+Rrv39mdz7A1xV1ujRWltNIeQfob+1h0OiZXyyW2UWo2m/NRDrDdHAPT2qz1aac1xb23p2mx3RftxnK0ivHsveYw7f/jhXD6lcS/V8CgCs1j65qehIEppDlY6/o9t8sWwSxrYYLMecXpz0RX11NEJ/Qoz9zDX66Ox9Va0WWoyuC/eFqqkhVpXe3DeJdCMaHp1bes++/wzVfi9Nli5LnThtzAFT7+oYg4gzmhWPxG4WKVnYs54pSH1fj4iKbtROco6klregboI6yLnSIPgdAH3G7o/tbqgC94aaCjUPGH1ffIbKCMeyCipaD2omOQ/qmwk/o1OmAG3MvG5ERJVaLaGZCGBKcPXlL8mVOu1yI4O+79TjivW4RGCqRqJBy6xYQez9XXlmhLYLumJA539r9d6Dl+f2BF75osKlDSOCqbuWFS0ln2CLRI1DvRClhjaIvs7UTCJ3/Vwo3hNzwDhD3esJ2UAm7VdBVVwrXkE+lK6SxbM=
Please give the key access to your repository: y█
► applying source secret "flux-system/flux-system"
✔ reconciled source secret
► generating sync manifests
✔ generated sync manifests
✔ sync manifests are up to date
► applying sync manifests
✔ reconciled sync configuration
◎ waiting for Kustomization "flux-system/flux-system" to be reconciled
✔ Kustomization reconciled successfully
► confirming components are healthy
✔ helm-controller: deployment ready
✔ notification-controller: deployment ready
✔ source-controller: deployment ready
✔ kustomize-controller: deployment ready
✔ all components are healthy