Skip to content

Enable physical server deployment - #35

Open
hertrste wants to merge 77 commits into
mainfrom
production-setup-v2
Open

Enable physical server deployment#35
hertrste wants to merge 77 commits into
mainfrom
production-setup-v2

Conversation

@hertrste

@hertrste hertrste commented Oct 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Implement necessary changes and make things configurable so we can deploy openstack-nix to actual physical hardware more convienently

Superseding: #34

Paul Kroeher added 23 commits October 2, 2026 16:39
Paul Kroeher @hertrste
nix: add option to disable destructive database setup
47b8c8b 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: add self build openstack-client to system packages
3058bbd 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move database setup into a separate script
1854ad6 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move keystone setup into a separate script
202396d 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move glance setup into a separate script
99773bb 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move cinder setup into a separate script
37173fc 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move placement setup into a separate script
4882375 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move nova setup into a separate script
b7e5d5c 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: move neutron setup into a separate script
2a693a6 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: rename generated scripts
38b8f51 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: split database script into create and cleanup
4dc5172 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: disable services but create all configurations and systemd units
ea89869 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: disable services but create all configurations and systemd units
f494897 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: disable services but create all configurations and systemd units
87aa499 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: rename mysql command and stop services before setup its database
65b688a 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: disable services but create all configurations and systemd units
74530a0 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix mysql database permissions
dbfd936 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: keystone configuration
2b1a97b 
Change enable logic of keystone
from generation of configuration to running real service

Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>
On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: change enabled logic of glance-api service
e95d94f 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: change cinder-api deployment to a uwsgi vassal
f50b357 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix cinder setup in CI/CD context
eb4cf30 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: change placement-api deployment to a uwsgi vassal
22ba8f2 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: nix cinder listen addresses
40eb410 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
@hertrste hertrste changed the title nix: add option to disable destructive database setup Enable physical server deployment Oct 2, 2026
Paul Kroeher added 6 commits October 14, 2026 11:10
Paul Kroeher @hertrste
nix: move global option into separate file
26c760c 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: production setup for cinder-storage-node
5050f22 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: production setup for compute-node
64b2dea 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: prod setup neutron-openvswitch-agent
3c6eef4 
Create a reboot capable version
of neutron-openvswitch-agent service

Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>
On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix listen address placement service
88b06bc 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix glance persistent directories after reboot
eef6f91 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher and others added 16 commits October 14, 2026 16:09
Paul Kroeher @hertrste
nix: fix typo and more failsafe setup script
79d9eb0 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: standardize nfs configuration
35be3b4 
Use config option storagePath
in CI/CD setup script and
add guard for nfs-server.

Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>
On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix linting
f78868d 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: enable caching in keystone
f22b194 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix keystone urls in all services
28b759c 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: set mariadb max_connections to 500
6305e05 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: removed knot3 backend
51a5ce7 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: run database cleanup in CI/CD
915d3ea 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: bugifxes storage node
39ba214 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: add openstack packages into system path
4bbeec8 
Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>

On-behalf-of: SAP paul.kroeher@sap.com
Paul Kroeher @hertrste
nix: fix neutron-openvswitch-agent systemd unit dependency
405855c 
neutron-openvswitch-agent should start after network
setup is completed by systemd-netword.service

This fixes a runtime race condition during the reboot.

Signed-off-by: Paul Kroeher <paul.kroeher@cyberus-technology.de>
On-behalf-of: SAP paul.kroeher@sap.com
@hertrste
nix: scope OpenStack options to their owning modules
38d4848 
Declare computeIP in the compute module and share controllerIP through
the global options module. Keep the controller test address in the
testing module and require deployments to supply their controller
address.

Remove the unused live_migration_inbound_addr option.

Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
nix: make manual Cinder setup device configurable
6cb90ad 
Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
test: properly wait for volume creation
916de64 
The basic test was slightly flaky because we have not waited for the
volume creation or the volume attachment to be successfull properly.

Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
tests: work around ssh config file permission
7d7eeac 
Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
controller: user defined controller name resolves via hosts
b0c9e41 
Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
hertrste marked this pull request as ready for review October 14, 2026 14:22
@hertrste
hertrste requested a review from tpressure October 14, 2026 14:23
@hertrste hertrste self-assigned this Oct 14, 2026
@hertrste
cinder: use configured storage path
3624312 
Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
hertrste force-pushed the production-setup-v2 branch from 453ba6e to 3624312 Compare October 14, 2026 14:25
@hertrste
cinder: fix cinder-schduler invocation
605ac06 
Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste
neutron: fix systemd dependency
3009d86 
We now wait for the provider interface to be ready before starting
certain newton services. Previously, the ovs newton service errored when
it was started too early because the explicit dependency was missing.

Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
@hertrste

hertrste commented Oct 16, 2026

Copy link
Copy Markdown
Contributor Author

Thomas and I have checked that our internal physical deployment still works as expected using the state of this MR.

@hertrste
nova: optional inbound_addr setting for migration
a606d78 
We allow optionally configuring the inbound_addr for live migration in
the nova config via a nixos option. Setting this, the user is able to
specify a specific interface to transfer the data when live migrating.
This can significantly speed up migration.

Signed-off-by: Stefan Kober <stefan.kober@cyberus-technology.de>
On-behalf-of: SAP stefan.kober@sap.com
hertrste
hertrste commented Oct 19, 2026
View reviewed changes
Comment thread modules/controller/cinder.nix

immediate-uid = "cinder";
immediate-gid = "cinder";
};

@hertrste hertrste Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be the same uwsgi setup for CI and manual deployment?

hertrste
hertrste commented Oct 19, 2026
View reviewed changes
Comment thread modules/controller/openstack-controller.nix
# openstack endpoint create --region RegionOne \
# dns "$interface" http://${config.openstack.controllerHostname}:9001/
# fi
#done

@hertrste hertrste Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check commented out code

hertrste
hertrste commented Oct 19, 2026
View reviewed changes
Comment thread modules/controller/openstack-controller.nix
source ${adminEnvScript}
exec ${script} "$@"
'';
};

@hertrste hertrste Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The scripts need to be available in a well known path for manual deployments

hertrste
hertrste commented Oct 19, 2026
View reviewed changes
Comment thread modules/controller/openstack-controller.nix
(setupCommand "openstack-nova-setup" novaStartScript)
(setupCommand "openstack-neutron-setup" neutronStartScript)
(setupCommand "openstack-designate-setup" designateStartScript)
(setupCommand "openstack-check-controller" checkControllerScript)

@hertrste hertrste Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There was an ordering of the scripts before, can we put that in the readme or somewhere else?

hertrste
hertrste commented Oct 19, 2026
View reviewed changes
Comment thread modules/controller/placement.nix
immediate-uid = "placement";
immediate-gid = "placement";
env = cfg.env;
};

@hertrste hertrste Oct 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See if we can use the same mechanism for manual and CI setup

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tpressure tpressure Awaiting requested review from tpressure

At least 1 approving review is required to merge this pull request.

Assignees

@hertrste hertrste

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@hertrste