Replies: 1 comment 5 replies
-
|
To clarify, this specifically happens when building for ARM64 on macOS |
Beta Was this translation helpful? Give feedback.
-
|
Could @akoken @babykart or other docker/k8s experts help us figure out why ARM64 on macOS might not be carrying the liblua54 library in the image? Thanks! We use KeraLua, which says it supports ARM. |
Beta Was this translation helpful? Give feedback.
-
|
and FYI, if we wrap this in a Dockerfile, it'll work. and the issue seems to be 2 fold.
|
Beta Was this translation helpful? Give feedback.
-
|
I’m not deeply familiar with KeraLua, but based on the points @darwin67 raised above, it seems we should include it in the Docker images. Since Garnet depends on KeraLua, and KeraLua in turn relies on a native shared library, bundling it directly would likely prevent runtime issues. It might look something like this: ...
RUN apt-get update \
&& apt-get install -y --no-install-recommends \
libaio1 \
liblua5.4-0 \
dpkg-dev \
&& ARCH="$(dpkg-architecture -qDEB_HOST_MULTIARCH)" \
# create a name KeraLua expects
&& if [ -f "/usr/lib/${ARCH}/liblua5.4.so.0" ]; then \
ln -sf "/usr/lib/${ARCH}/liblua5.4.so.0" "/usr/lib/${ARCH}/liblua54.so"; \
fi \
# link into the dotnet shared runtme folder
&& DOTNET_SHARED_DIR=/usr/share/dotnet/shared/Microsoft.NETCore.App \
&& if [ -d "$DOTNET_SHARED_DIR" ]; then \
DNVER="$(ls -1 $DOTNET_SHARED_DIR | head -n1 || true)"; \
if [ -n "$DNVER" ]; then \
mkdir -p "$DOTNET_SHARED_DIR/$DNVER"; \
ln -sf "/usr/lib/${ARCH}/liblua5.4.so.0" "$DOTNET_SHARED_DIR/$DNVER/liblua54.so" || true; \
fi \
fi \
&& rm -rf /var/lib/apt/lists/*
... |
Beta Was this translation helpful? Give feedback.
-
|
How come this file gets automatically copied over to the Garnet app folder in case of other platforms? Restoring KeraLua should bring in the correct library automatically. |
Beta Was this translation helpful? Give feedback.
-
|
There could be a couple of possible causes for this. I’ve double-checked whether the issue was related to Docker layer caching by rebuilding without any cached layers, but the result was the same. I also tried running it with Podman and encountered the same error. From what I can tell, the problem seems to be with the NuGet packaging of KeraLua. It doesn’t appear to include the native library for arm64. I found a similar issue reported here: NLua/KeraLua#80. It’s unclear when the author will be able to address this. If maximum reliability is our priority, I’d suggest manually installing this package as a workaround. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
We're building a k8s operator for Garnet, and while testing using the official docker image, we noticed that it has issues with loading Lua in the logs.
config is mostly default settings with some minor tweaks for local testing purposes.
{ "AadAuthority": "https://login.microsoftonline.com", "AclFile": "/etc/garnet/acl/users.acl", "AofMemorySize": "64m", "AofPageSize": "4m", "AofReplicationRefreshFrequencyMs": 10, "AuthenticationMode": "ACL", "CertFileName": "/etc/garnet/cert.pfx", "CertificateRevocationCheckMode": "NoCheck", "CheckpointDir": "/var/garnet/snapshot", "ClusterAnnouncePort": 6379, "ClusterPassword": "clusterPassword", "ClusterTimeout": 5, "ClusterTlsClientTargetHost": "GarnetTest", "ClusterUsername": "clusterUsername", "CompactionMaxSegments": 32, "CompactionType": "None", "EnableAOF": true, "EnableCluster": true, "EnableDebugCommand": "yes", "EnableFastCommit": true, "EnableLua": true, "EnableModuleCommand": "no", "EnableStorageTier": true, "ExpiredKeyDeletionScanFrequencySecs": -1, "FastCommitThrottleFreq": 1000, "GossipDelay": 5, "GossipSamplePercent": 100, "IndexResizeFrequencySecs": 60, "IndexResizeThreshold": 50, "IndexSize": "128m", "LogDir": "/var/garnet/data", "LogLevel": "Trace", "LoggingFrequency": "5", "LuaLoggingMode": "Enable", "LuaMemoryManagementMode": "Native", "LuaTransactionMode": true, "MaxDatabases": 16, "MemorySize": "8g", "MutablePercent": 90, "NetworkConnectionLimit": -1, "NetworkSendThrottleMax": 8, "ObjectScanCountLimit": 1000, "ObjectStoreCompactionMaxSegments": 32, "ObjectStoreIndexSize": "16m", "ObjectStoreLogMemorySize": "32m", "ObjectStoreMutablePercent": 90, "ObjectStorePageSize": "4k", "ObjectStoreReadCacheLogMemorySize": "32m", "ObjectStoreReadCachePageSize": "1m", "ObjectStoreSegmentSize": "32m", "OnDemandCheckpoint": true, "PageSize": "32m", "ParallelMigrateTaskCount": 1, "Port": 6379, "ProtectedMode": "yes", "PubSubPageSize": "4k", "ReadCacheMemorySize": "1g", "ReadCachePageSize": "32m", "Recover": true, "ReplicaAttachTimeout": 60, "ReplicaDisklessSyncDelay": 5, "ReplicaSyncDelayMs": 5, "ReplicaSyncTimeout": 5, "ReplicationOffsetMaxLag": -1, "RevivObjBinRecordCount": 256, "RevivifiableFraction": "1.0", "SegmentSize": "1g", "ServerCertificateRequired": true, "SlowLogMaxEntries": 128 }Just wanna ask is this expected?
We can get this working by building on top of the official image, but it was surprising the object files are not included and enabling Lua will just fail.
Beta Was this translation helpful? Give feedback.
All reactions