Commit Graph

123 Commits

Author SHA1 Message Date
Robert Marshall 10c817c6e5
Update Cinc/Ohai to 18.x series
- Add unf_ext gem because it is a direct dependency for Cinc versions
  greater than 18.0.169
- Updates Cinc gem from 17.10.95 to 18.3.0
- Updates Ohai gem from 17.9.0 to 18.1.3
- Updates software config for chef-bin, chef-gem, and ohai
- Remove ohai gem version workaround

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/8294

Changelog: changed

Signed-off-by: Robert Marshall <rmarshall@gitlab.com>
2024-01-25 10:09:14 -08:00
Mayra Cabrera 45d008584d Revert "Merge branch 'chef-18-update' into 'master'"
This reverts merge request !6997
2024-01-17 21:02:55 +00:00
Robert Marshall db9b432193 Update Cinc/Ohai to 18.x series
- Add unf_ext gem because it is a direct dependency for Cinc versions
  greater than 18.0.169
- Updates Cinc gem from 17.10.95 to 18.3.0
- Updates Ohai gem from 17.9.0 to 18.1.3
- Updates software config for chef-bin, chef-gem, and ohai
- Remove ohai gem version workaround

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/8294

Changelog: changed
Signed-off-by: Robert Marshall <rmarshall@gitlab.com>
2024-01-17 15:58:19 +00:00
Clemens Beck d7ed881347 Revert "Merge branch 'update-chef-gem' into 'master'"
This reverts merge request !7276
2024-01-13 13:59:53 +00:00
Clemens Beck 69abe66e77
Update chef from 17.10.0 to 17.10.95
Changelog: changed
2023-12-04 10:33:48 +01:00
Balasankar 'Balu' C a263339d5d Use google-cloud-storage gem for uploading packages to GCS
- Replace google cloud SDK with the google-cloud-storage gem
  thereby reducing the total footprint size of the builders

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/8088

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2023-09-29 22:08:40 +00:00
Dustin Collins 82bdaa5593 Update tomlib to v0.6.0 to correctly escape special characters
Changelog: changed
2023-06-12 08:54:37 +00:00
Sami Hiltunen 4dff04a602 Match Praefect's configuration format in Omnibus
The configuration formats of Praefect and Omnibus deviate from each
other creating a few problems:

1. Configuration keys for the same option differ between the context of
   Omnibus and Praefect creating confusion for the user.

2. Each new key added requires duplicate work to map the different keys
   into Omnibus.

This change introduces praefect['configuration'] matching configuration
in Omnibus with Praefect's own format. The previous configuration keys
are remapped into this new format to assist administrators during the
transition period.

The tomlrb gem does not supporting encoding TOML, so the tomlib gem has
been added as a dependency. The configuration values are now serialized
directly into TOML instead of using a template.

Removes unneeded values allowing Praefect's own source to be the single
source of truth for configuration.

Updates tests because the new serialization method does not output empty
config sections.

Guards are included to prevent errors with latency configurations that
must be arrays where the previous configuration expected a string until
such time as Praefect's own validation subroutines are implemented.

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/7422

Changelog: changed
2023-02-17 04:12:08 +00:00
Hossein Pursultani 38a0e35faa Revert "Merge branch 'smh-generic-praefect-templating' into 'master'"
This reverts merge request !6373
2023-02-02 03:03:05 +00:00
Sami Hiltunen a82c788d46 Match Praefect's configuration format in Omnibus
The configuration formats between Praefect and Omnibus deviate from
each other.  This has a few problems:

1. The configuration keys differ in Omnibus from what Praefect uses. This
makes things confusing as the keys for the same options are different in
different contexts.

2. This forces us to duplicate the configuration in Omnibus' template to
map the different keys. This creates menial work and requires us to touch
Omnibus everytime new configuration keys are added.

This commit solves the problem by matching the configuration format of Praefect
in Omnibus completely with Praefect's own format. This is done by introducing the
submap Gitlab['praefect']['configuration'] which gets directly serialized as TOML.
As existing installations still depend on the old keys, compatbility code is added
to transfer the configuration to their new locations. We should later deprecate the
old keys and ask users to move the configuration to its new location.

Additionally, the unneeded default values are removed. This ensures the default
values are not duplicated and can be controlled for both source and Omnibus
installations by just updating Praefect's source.

As tomlrb does not support encoding TOML, dependency to tomlib was added to do so.

Tests had a slight change as the old template was outputting empty config sections
which are not needed. The new code outputs no unnecessary empty sections.

Changelog: changed
2023-02-01 18:45:29 +00:00
Takuya Noguchi ee1c189130 Update gitlab-styles from 7.1.0 to 9.0.0
to update rubocop from 0.93.1 to 1.36.0.

Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
Changelog: fixed
2022-09-15 15:06:20 +00:00
Reuben Pereira a5f0ae8c3b Retry package upload
Use the retriable gem to retry uploading of packages if it fails.
It will retry 10 times, with a total wait time of about 6 minutes.
If the upload continues to fail, an exception will be raised.
2022-08-31 09:42:51 +05:30
Robert Marshall 2e70be7773 Merge branch 'tnir-gitlab-styles-to-7.1.0' into 'master'
Update gitlab-styles from 6.1.0 to 7.1.0

See merge request gitlab-org/omnibus-gitlab!6279
2022-08-26 16:41:11 +00:00
Takuya Noguchi 6764d7ab3c Replace byebug and pry
- Replace byebug with ruby/debug
- Replaces pry with irb

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/6955

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/6956

Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>

Changelog: other
2022-08-25 23:17:12 +00:00
Takuya Noguchi 275e615269 Update gitlab-styles from 6.1.0 to 7.1.0
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2022-08-18 05:30:13 +00:00
Robert Marshall 7db837f052 Merge branch 'remove-license-scout-usage' into 'master'
Update omnibus version to remove usage of license_scout

Closes #6196

See merge request gitlab-org/omnibus-gitlab!6260
2022-08-17 21:14:22 +00:00
Balasankar 'Balu' C f9736759c7 Update omnibus version to remove usage of license_scout
Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/6196

Changelog: changed

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2022-08-17 21:14:22 +00:00
Balasankar 'Balu' C 2ceee4c892 Use gitlab-dangerfiles gem
Use the common features such as changelog checks provided
by gitlab-dangerfiles and clean up the file structure for
easier maintenance and upkeep with the broader changes
across the organization.

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2022-08-16 22:45:11 +00:00
Robert Marshall 60cf1e7806 Merge branch 'tnir-packagecloud-to-0.3.09' into 'master'
Update package_cloud from 0.3.05 to 0.3.09

See merge request gitlab-org/omnibus-gitlab!6243
2022-08-05 20:31:56 +00:00
Takuya Noguchi cae0c78808 Update package_cloud from 0.3.05 to 0.3.09
- Updates package cloud and related gems, notably the thor gem
  which is used as part of Omnibus GitLab.

Changelog: changed

Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2022-08-05 20:31:56 +00:00
Takuya Noguchi a3284efd96 Use bundle update to update gem
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2022-08-03 05:08:17 +00:00
Robert Marshall 58c494a8bc Update to CINC version 17.10
- cinc version 17.10 is ruby 3 compatible
- update ohai version now supports AlmaLinux and RockyLinux
- update related dependencies and chef ecosystem gems
- update Omnibus GitLab cookbooks to resolve deprecation warnings for
  upcoming behavior changes in cinc version 18.x
- update runit cookbook resources to support newer cinc version
- update crond_job extension to match changes in upstream crond resource
  related to newer versions of cinc

Signed-off-by: Robert Marshall <rmarshall@gitlab.com>
2022-06-14 05:48:32 +00:00
Balasankar 'Balu' C 6ed8bc2589 Merge branch '6404-migrate-to-parallel-cinc-version' into 'master'
Migrate from Chef to Cinc

Closes #6777 and #6404

See merge request gitlab-org/omnibus-gitlab!6032
2022-05-06 04:22:46 +00:00
Robert Marshall b892aa1bf4 Migrate to cinc from chef
- Use cinc as a replacement for Chef in Omnibus GitLab. To avoid
  conflating migration issues with upgrade issues, the change
  intentionally uses the cinc version that parallels the version of chef
  currently shipping in the Omnibus GitLab package.

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/6404

Closes https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/6777

Changelog: changed

Signed-off-by: Robert Marshall <rmarshall@gitlab.com>
2022-05-06 04:22:45 +00:00
Balasankar "Balu" C 33d87b8f10 Add test coverage reports
Introduces simplecove test coverage tracking to the CI pipelines.

Related https://gitlab.com/gitlab-org/omnibus-gitlab/-/issues/4809

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2022-05-02 18:42:58 -04:00
Balasankar 'Balu' C 19aec0fa99 Revert "Merge branch 'use-gitlab-dangerfiles' into 'master'"
This reverts merge request !5947
2022-03-25 03:50:26 +00:00
Rémy Coutable 1b8421cebf
Move Danger rules under danger/
Signed-off-by: Rémy Coutable <remy@rymai.me>
2022-03-24 12:05:17 +01:00
Rémy Coutable 23da323d14
Use the shared `danger-review` job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2022-03-24 11:12:05 +01:00
Robert Marshall 981e78d016 Use public sources for omnibus-gitlab builds by default
Changelog: changed
2021-11-18 07:11:32 +00:00
Balasankar 'Balu' C 6bd30d8f9d Include license and notice in license_finder output 2021-11-17 23:31:37 +00:00
Balasankar "Balu" C d94c515b9b
Bump omnibus to 8.2.1.1
Changelog: changed
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-10-22 21:54:34 +05:30
Balasankar "Balu" C 0b970c9ece
Bump omnibus to 8.2.1
GitLab specific changes were applied to 8.2.1 via
https://gitlab.com/gitlab-org/omnibus/-/merge_requests/28, thus creating
8.2.1-stable branch and a new tag 8.2.1.0 was cut from it.

Changelog: changed
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-09-29 22:03:04 +05:30
deps 62f95b0ab9
Update chef gems to 15.17.4
- `chef/chef-zero` from 15.0.3 to 15.0.7
- `chef/chef` from 15.14.0 to 15.17.4
- `chef/chef-bin` from 14.14.0 to 15.17.4

Changelog: changed
2021-08-24 10:11:02 -07:00
Balasankar 'Balu' C 8f82455851 Merge branch 'brodock/yard' into 'master'
Add yard to generate ruby code documentation

See merge request gitlab-org/omnibus-gitlab!5551
2021-08-24 04:44:29 +00:00
Gabriel Mazetto b774a14b4d Add yard to generate Ruby code documentation 2021-08-24 04:44:29 +00:00
Balasankar "Balu" C 2b45c402ab
Use new version of omnibus
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-08-23 13:41:26 +05:30
Balasankar "Balu" C b43ffbe73a
Use latest omnibus tag for verbose cache related messages
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-08-10 09:50:38 +05:30
Balasankar "Balu" C 3da428dd84
Add code to trigger alert on package size increases
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-07-10 08:29:06 +05:30
Balasankar "Balu" C 2356c9c088
Remove upgrade time measuring job and related code
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-05-26 09:05:47 +05:30
Takuya Noguchi 44ce9f2e10 Update gitlab-styles from 4.3.0 to 6.1.0
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2021-04-26 22:26:00 +00:00
Robert Speicher b15354c495
Disable fetcher progress bar globally
Updates Omnibus to 7.0.10.09

Related: https://gitlab.com/gitlab-org/omnibus/-/merge_requests/22
2021-04-20 11:55:50 -05:00
DJ Mountney 2712b7391b
Update omnibus gem to include net-fetcher retry 2021-03-25 11:58:50 -07:00
Balasankar "Balu" C d88e3c2963
Use SHA256 for signing RPM packages
Changelog: changed
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2021-03-11 09:55:17 +05:30
Balasankar "Balu" C 48d9f6d54a Move AMI creation task to a namespace
Signed-off-by: Balasankar "Balu" C <balasankarc@autistici.org>
2021-02-02 16:01:06 +00:00
DJ Mountney 0fb8ccc22f
Move packagecloud gem to its own group, so we only get jsonpure warnings
in upload jobs
2021-01-11 10:13:05 -08:00
DJ Mountney 57a416fc8a
Update our omnibus gem to a version with more debug information
Shows some download metadata for a file after its checksum fails.
2020-11-09 12:19:00 -08:00
DJ Mountney ce5655670a Merge branch 'new-omnibus-version-with-vendor' into 'master'
Specify `vendor` field in software definitions for dependency scanner

See merge request gitlab-org/omnibus-gitlab!4693
2020-11-03 16:03:25 +00:00
Balasankar "Balu" C b0eca974fe Use new version of omnibus with vendor support
Signed-off-by: Balasankar "Balu" C <balasankarc@autistici.org>
2020-11-03 16:03:25 +00:00
Stan Hu d09a84eefb Bump gitlab-styles version to pull in Rubocop update 2020-10-30 21:55:20 -07:00
DJ Mountney f4733627ad
Update omnibus gem to fix ruby 2.7
Updated includes patch that fixes building omnibus projects using ruby
2..7
2020-10-16 09:16:01 -07:00