doc for hackathon 2024

[DaanHoogland]

https://docs.google.com/document/d/1W9QTQBhkChUNnA8a2O5Uu9SeZdIPoMsoEGVtF_baEIU/edit?tab=t.0

[DaanHoogland]

Ideas:

Idea | Proposed By | Description | Comments -- | -- | -- | -- CloudStack Extensions | Rohit Yadav | Given simple interfaces (input/output expectations) ACS extensions are any script (Python, Shell), or binary (Go, Rust, etc.) which allow sysadmins/sre/ops admins to write them. The aim of this idea is to discuss and gather list of what kind of extension and type are possible. For example, authentication, 2FA validation etc. | To discuss & discover simpler feature interfaces and hack some extensions.Largely an idea and design topic. Build Cloudstack Packages for Arch linux | Kiran chavala | Check the feasibility of cloudstack support for archlinuxhttps://archlinux.org/Since archlinux is quite popular among self hosted community and other open source enthusiast | https://ipv6.rs/tutorial/Arch_Linux/CloudStack/https://github.com/Fincer/cloudstack_archlinux/tree/main Explore out of the box RPC implementations | Daan Hoogland | Use an RPC mechanism that is not maintained (and outdated) just for ACS but that has more users and thus a broader set of maintainers. | Goto after a quick search is https://thrift.apache.org/ but surely there are more possibilities.Part of the goal is to have a usinifed mech of communications between all parts of the system. And external part/3rd party plugins could leverage the services in a more standard way, instead of the old API. Priority-based security issues management | Boris Stoyanov | With the increased interest in the project, we’re seeing a rise in security issues being reported—an encouraging sign of the community’s engagement and commitment to improvement. Over the past summer, we addressed all reported issues and issued security releases, which has been greatly beneficial to both the community and the project as a whole. However, this process has been quite demanding on the team, requiring significant time and effort.To make this process more efficient and sustainable, we could consider implementing a system that prioritizes issues based on severity. For example, if a low-severity issue with a viable workaround is reported, we could bundle several such issues into a single release and provide public guidance on the workaround. This would allow users to remain protected while reducing the immediate pressure on PMC members, enabling them to prioritize their efforts more effectively.This approach would not only streamline the response to security issues but also sustain a balanced workload, ensuring that the team can focus on high-impact vulnerabilities without the strain of addressing all issues with the same urgency. | The idea of the session is to gain support and build the idea, then post it on the mailing list for discussion. CloudStack installer | Rohit Yadav | Discuss, review and continue WIP ACS script installer c8k.in/stall.shAlso explore container based installer. |     |   |   |  

Hackathon Agenda:

Start: 12:30 GMT+2

Presentation of the ideas and developments: 16:30 GMT+2

Finish: 18:00 GMT+2

Ideas:

Idea
Proposed By
Description
Comments
CloudStack Extensions
Rohit Yadav
Given simple interfaces (input/output expectations) ACS extensions are any script (Python, Shell), or binary (Go, Rust, etc.) which allow sysadmins/sre/ops admins to write them.

The aim of this idea is to discuss and gather list of what kind of extension and type are possible. For example, authentication, 2FA validation etc.
To discuss & discover simpler feature interfaces and hack some extensions.

Largely an idea and design topic.
Build Cloudstack Packages for Arch linux
Kiran chavala
Check the feasibility of cloudstack support for archlinux

https://archlinux.org//

Since archlinux is quite popular among self hosted community and other open source enthusiast

https://ipv6.rs/tutorial/Arch_Linux/CloudStack/

https://github.com/Fincer/cloudstack_archlinux/tree/main

Explore out of the box RPC implementations
Daan Hoogland
Use an RPC mechanism that is not maintained (and outdated) just for ACS but that has more users and thus a broader set of maintainers.
Goto after a quick search is https://thrift.apache.org/ but surely there are more possibilities.
Part of the goal is to have a usinifed mech of communications between all parts of the system. And external part/3rd party plugins could leverage the services in a more standard way, instead of the old API.
Priority-based security issues management
Boris Stoyanov
With the increased interest in the project, we’re seeing a rise in security issues being reported—an encouraging sign of the community’s engagement and commitment to improvement. Over the past summer, we addressed all reported issues and issued security releases, which has been greatly beneficial to both the community and the project as a whole. However, this process has been quite demanding on the team, requiring significant time and effort.

To make this process more efficient and sustainable, we could consider implementing a system that prioritizes issues based on severity. For example, if a low-severity issue with a viable workaround is reported, we could bundle several such issues into a single release and provide public guidance on the workaround. This would allow users to remain protected while reducing the immediate pressure on PMC members, enabling them to prioritize their efforts more effectively.

This approach would not only streamline the response to security issues but also sustain a balanced workload, ensuring that the team can focus on high-impact vulnerabilities without the strain of addressing all issues with the same urgency.
The idea of the session is to gain support and build the idea, then post it on the mailing list for discussion.
CloudStack installer
Rohit Yadav
Discuss, review and continue WIP ACS script installer c8k.in/stall.sh

Also explore container based installer.

Hackathon Agenda:

Start: 12:30 GMT+2

Presentation of the ideas and developments: 16:30 GMT+2
Finish: 18:00 GMT+2

[rohityadavcloud]

All, please use this to add your ideas on CloudStack extension - #9952

[taocnrut]

Better integration/polishing/documentation with KVM with CLVM - lvmlockd for SAN based LUNs @DaanHoogland
(apropos general feeling from docs and mailing lists that "KVM, however, doesn't have a normal fiber channel shared storage option. I don't trust software-defined storages like CEPH or vSAN, as they introduce fatal bugs almost every month that can result in data loss.")

[NuxRo]

SAN based storage remains a bit of a problem with the likes of OCFS2 or cLVM not being very good solutions.
Last I remember clvm was incompatible with thin provisioning, so you would end up with fat provisioning of volumes and very slow template deployments and volume snapshot operations.

I do agree that oVirt (OLVM?) (as was suggested) does it well, they also use lvm, but afaik they implement their own locking and even expose the block device in qcow2 format.
It's definitely worth having a look for inspiration.

[jgotteswinter]

Ovirt uses a random node per dc for this locking mechanism (SPM role). More description here: https://www.ovirt.org/develop/developer-guide/vdsm/sanlock.html

[NuxRo]

Also,just leaving this here:
https://www.phoronix.com/news/Linux-6.10-Faster-OCFS2
https://www.phoronix.com/news/Oracle-UEK-Next-Linux-6.10

[taocnrut]

I think we would not need to tackle with sanlock directly since it is already (optionaly) used with lvm when volume group is created as shared (with vgcreate --shared)
https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/8/html/configuring_and_managing_logical_volumes/configuring-lvm-on-shared-storage_configuring-and-managing-logical-volumes#configuring-lvm-on-san-multiple_configuring-lvm-on-shared-storage

https://www.man7.org/linux/man-pages/man8/lvmlockd.8.html

We should only need to take care of calling lvchange -an/lvchange -ay when apropriate provided that vg is created as shared and each host has unique host_id if sanlock is configured to be used (other option is dlm/corosync)

I'll open issue with example of configuration and observed behaviour at this moment..