artiq_influx_generic PKGBUILD Help/Review for MSYS2

jfniedermeyer

Hello all,

We're trying to update to the stable channel of ARTIQ 8 on a (IT security policy enforced) Windows machine. Since Conda isn't playing nicely with the stable build and because it's officially deprecated, we're moving over to MSYS2/CLANG64. We're having issues getting NDSPs to work (a related post will ask for help with thorlabs_tcube).

We'd like to continue using the ARTIQ Influx Bridge, but it doesn't have an MSYS2 package compiled yet. I'm also reaching out to the maintainer of that repo to try and get assistance.

I've tried making a PKGBUILD so that makepkg can compile this NDSP and I can use it in MSYS2. I'm am new to Arch, so trying to piece together a PKGBUILD is a bit arcane to me. What I've written will compile the repo from git and install it under ../clang64/lib/Python3.11/site-packages, but when I try and use it, I get an error from artiq_ctlmgr of Fatal Error in Launcher: Failed to Retrieve Appended Archive.

Here is the PKGBUILD that I run in a fresh offline installer of MSYS2 with ARTIQ using makepkg -si, which will download the dependencies and then install using pacman -U. Any errors in here that people more knowledgeable than me see? Thanks in advance!

pkgname=artiq_influx_generic
source=("artiq_influx_generic::git+https://gitlab.com/charlesbaynham/artiq_influx_generic.git")
sha256sums=('SKIP')
md5sums=('SKIP')

makedepends=(git mingw-w64-clang-x86_64-python-build mingw-w64-clang-x86_64-python-installer mingw-w64-clang-x86_64-python-wheel mingw-w64-clang-x86_64-python-poetry-core)

build() {
    cp -r "${pkgname}" "python-build-${MSYSTEM}" && cd "python-build-${MSYSTEM}"
    ${MINGW_PREFIX}/bin/python -m build --wheel --no-isolation
}

package() {
    cd "${srcdir}/python-build-${MSYSTEM}"
  MSYS2_ARG_CONV_EXCL="--prefix=" \
    ${MINGW_PREFIX}/bin/python -m installer --prefix=${MINGW_PREFIX} \
    --destdir="${pkgdir}" dist/*.whl
}

fsagbuya

Hi jfniedermeyer,

You can try making the following changes and building. It successfully builds for me, but I haven’t been able to test it. This assumes that sipyco and artiq-comtools are already installed in your MSYS2 environment.

index 15c7ae6..4d20573 100644
--- a/PKGBUILD
+++ b/PKGBUILD
@@ -1,13 +1,24 @@
-pkgname=artiq_influx_generic
-source=("artiq_influx_generic::git+https://gitlab.com/charlesbaynham/artiq_influx_generic.git")
-sha256sums=('SKIP')
-md5sums=('SKIP')
+_realname=artiq_influx_generic
+pkgbase=mingw-w64-python-${_realname}
+pkgname=("${MINGW_PACKAGE_PREFIX}-python-${_realname}")
+pkgver=0.2
+pkgrel=1
+arch=('any')
+mingw_arch=('mingw64' 'ucrt64' 'clang64' 'clangarm64')
+depends=("${MINGW_PACKAGE_PREFIX}-python")
+makedepends=("${MINGW_PACKAGE_PREFIX}-python-build"
+             "${MINGW_PACKAGE_PREFIX}-python-installer"
+             "${MINGW_PACKAGE_PREFIX}-python-poetry-core")
+source=("https://gitlab.com/charlesbaynham/artiq_influx_generic/-/archive/b5c51b43554ff8ef8833327cb257eec80a67ef7e.tar.gz")
+sha256sums=('eb72a2d0d0599f31fc656e1d306c555c12a6811ab58283d3e4c70d19280be8d5')
 
-makedepends=(git mingw-w64-clang-x86_64-python-build mingw-w64-clang-x86_64-python-installer mingw-w64-clang-x86_64-py
thon-wheel mingw-w64-clang-x86_64-python-poetry-core)
+prepare() {
+  mv "${_realname}-b5c51b43554ff8ef8833327cb257eec80a67ef7e" "${_realname}-${pkgver}"
+}
 
 build() {
-  cp -r "${pkgname}" "python-build-${MSYSTEM}" && cd "python-build-${MSYSTEM}"
-  ${MINGW_PREFIX}/bin/python -m build --wheel --no-isolation
+  cp -r "${_realname}-${pkgver}" "python-build-${MSYSTEM}" && cd "python-build-${MSYSTEM}"
+  ${MINGW_PREFIX}/bin/python -m build --wheel --skip-dependency-check --no-isolation
 }
 
 package() {

jfniedermeyer

fsagbuya
Hi again, thanks for fixing this up! Unfortunately, the same error is raised. I still get the following error in artiq_ctlmgr. I've verified that sipyco and artiq-comtools are already installed. The traceback itself isn't terribly illuminating.

INFO:ctlmgr(HOST):artiq_comtools.ctlmgr:Starting controller logger_influx with command: artiq_influx_generic --baseurl-db INFLUXSERVER --user-db USER --password-db PASS --database DB --table TABLE --port PORT --bind HOST
INFO:controller(logger_influx):print:Fatal error in launcher: Unable to find an appended archive.
WARNING:ctlmgr(HOST):artiq_comtools.ctlmgr:Controller logger_influx exited

I kept the package the same as in my original. Did I interpret that correctly from your post?

fsagbuya

jfniedermeyer

There could be issues with the packaging of artiq_influx_generic. Try editing the device_db line to:

"command": "python /abs/path/to/artiq_influx_generic.py"

instead of directly calling artiq_influx_generic.

jfniedermeyer

fsagbuya This did the trick to fix the import error!

MSYS2 has an added complication in that if your influx server uses a self-signed SSL certificate or in general is on an https address, MSYS2 does not use the Windows certificate store, but instead uses its own store. This means that you have to either 1.) disable SSL verification (I would NOT in general suggest this) or 2.) generate your certificate keys in PowerShell and point aiohttp to the proper store using a certifi hack. I'll detail this below.

To generate your certificate file, open PowerShell and run the following script to generate windows.pem in C:\Users\<USERNAME>:

get-childitem -path cert:\LocalMachine\Root | ForEach-Object {
	$hash = $_.GetCertHashString()
	$base64certificate = @"
-----BEGIN CERTIFICATE-----
$([Convert]::ToBase64String($_.export('Cert'), [System.Base64FormattingOptions]::InsertLineBreaks))
-----END CERTIFICATE-----

"@
	[System.IO.File]::AppendAllText("$home\windows.pem", $base64certificate)
}

Open this windows.pem file in your favorite text editor and copy the contents.

In MSYS2 run pacaman -S mingw-w64-clang-x86_64-python-certifi to install the certifi package. Then in the MSYS2 console run echo "import certifi; print(certifi.where())" | python. Find the file that is printed, open it in your favorite text editor and paste the contents of windows.pem into it.

Now, open ../clang64/python3.11/site-packages/artiq_influx_generic/artiq_influx_generic.py. import both ssl and certifi. define a module level variable of ssl_ctx=ssl.create_default_context(cafile=certifi.where()).

Finally, in DBWriter._do and DBReader.send_query replace the lines async with aiohttp.ClientSession() as session: with async with aiohttp.ClientSession(connector=aiohttp.TCPConnector(ssl=ssl_ctx)) as session:.

This will allow you to access your Windows SSL certificate store, which contains your self-signed and other SSL certs, inside MSYS2 and write data to your influx.

I'll send an email about this to the repo's maintainer and I would also welcome any more elegant solution that doesn't require PowerShell and a manual copy/paste.