- Generated by
1.9.1
|
ChampSim
|
vcpkg-eg-mac VMs The most common operation here is to set up a new VM for Azure pipelines; we try to make that operation as easy as possible. It should take all of three steps, assuming the machine is already set up (or read these instructions for how to set up a machine):
azure-pipelines.yml and azure-pipelines-osx.yml to point to the new macOS pool.Whenever we want to install updated versions of the command line tools, or of macOS, we need to create a new vagrant box. This is pretty easy, but the results of the creation are not public, since we're concerned about licensing. However, if you're sure you're following Apple's licensing, you can set up your own vagrant boxes that are the same as ours by doing the following:
You'll need some prerequisites:
Install-Prerequisites.ps1If you're updating the CI pool, make sure you update macOS.
First, you'll need to create a base VM; this is where you determine what version of macOS is installed. Follow the Parallels process for creating a macOS VM; this involves updating to whatever version, and then scrolling right until you find "Install macOS from recovery partition".
Once you've done this, you can run through the installation of macOS onto a new VM. You should set the username to vagrant.
Once it's finished installing, make sure to turn on the SSH server. Open System Preferences, then go to Sharing > Remote Login, and turn it on. You'll then want to add the vagrant SSH keys to the VM's vagrant user. Open the terminal application and run the following:
Finally, you'll need to install the Parallel Tools. From your host, in the top bar, go to Actions > Install Parallels Tools..., and then follow the instructions.
Now, let's package the VM into a base box. (The following instructions are adapted from these official instructions).
Run the following commands:
This will create a box file which contains all the necessary data. You can delete the metadata.json file after.
Once you've done that, you can upload it to the fileshare, under share/boxes/macos-base, add it to share/boxes/macos-base.json, and finally add it to vagrant:
Then, we'll create the final box, which contains all the necessary programs for doing CI work. Copy configuration/Vagrantfile-box.rb as Vagrantfile, and configuration/vagrant-box-configuration.json into a new directory; into that same directory, download the Xcode command line tools dmg, and name it clt.dmg. Then, run the following in that directory:
This will create a package.box, which is the box file for the base VM. Once you've created this box, if you're making it the new box for the CI, upload it to the fileshare, under share/boxes/macos-ci. Then, add the metadata about the box (the name and version) to share/boxes/macos-ci.json. Once you've done that, add the software versions under VM Software Versions.
When updating the macOS machines to a new version, you'll need to create a new agent pool for the machines to join. The standard for this is to name it PrOsx-YYYY-MM-DD, with YYYY-MM-DD the day that the process is started.
In order to create a new agent pool, go to the vcpkg/public project; go to Project settings, then go to Agent pools under Pipelines. Add a new self-hosted pool, name it as above, and make certain to check the box for "Grant access permission to all pipelines".
Once you've done this, you are done; you can start adding new machines to the pool!
First, make sure that your software is up to date:
as well as checking to make sure macOS is up to date.
Then, follow the instructions for accessing ~/vagrant/share.
And finally, grab a PAT, update the vagrant box, set up the VM, and run it:
Personal Access Tokens are an important part of this process, and they are fairly easy to generate. On ADO, under the correct project (in vcpkg's case, "vcpkg"), click on the "User Settings" icon, then go to "Personal access tokens". It is the icon to the left of your user icon, in the top right corner.
Then, create a new token, give it a name, make sure it expires quickly, and give it a custom defined scope that includes the "Agent pools: Read & manage" permission (you'll need to "Show all scopes" to access this). You can now copy this token and use it to allow machines to join.
Before anything else, one must download brew and powershell.
Then, we need to download the vcpkg repository:
Then, we need to mint an SSH key:
Add that SSH key to authorized_keys on the file share machine with the base box.
Next, install prerequisites:
And finally, make sure you can access ~/vagrant/share.
The following are issues that we've run into:
vagrant up doesn't work, and vagrant gives the error that the VM is ‘'stopped’.
- Try logging into the GUI with the KVM, and retryingvagrant up
.
(when running a powershell script) The errorFailed to initialize CoreCLR, HRESULT: 0x8007001F` is printed.
- Reboot the machine; run $ sudo shutdown -r now
and wait for the machine to start back up. Then, start again from where the error was emitted.
The fileshare is located on vcpkgmm-01, under the fileshare user, in the share directory. In order to get sshfs working on the physical machine, You can run Install-Prerequisites.ps1 to grab the right software, then either:
If you get an error, that means that gatekeeper has prevented the kernel extension from loading, so you'll need to access the GUI of the machine, go to System Preferences, Security & Privacy, General, unlock the settings, and allow system extensions from the osxfuse developer to run. Then, you'll be able to add ~/vagrant/share as an sshfs.
1.9.1