Cant run cargo test on linux

[denumerate]

On rustler 0.34, linux, rust 1.79, erlang 26, and newly created crate (via mix rustler.new) cargo test fails with the below error:

cargo test tests::test_basic 
   Compiling bdd v0.1.0 (/home/iam/Work/guesswork/native/bdd)
error: linking with `cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/home/iam/.asdf/shims:/home/iam/.asdf/bin:/home/iam/.cargo/bin:/home/iam/.config/emacs/bin:/home/iam/.local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/home/iam/.local/bin:/home/iam/.local/bin" VSLANG="1033" "cc" "-m64" "/tmp/rustcqnqeOV/symbols.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.109j10gnneabf3sr.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.10mdn7d3ihi7lltf.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.11vofoijlwmk1kj2.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.170b4rnddcdio3n8.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1eul9q75jewpsi6g.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1ip7lmaxqod9j97t.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1m4fj14gjl73gf2z.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1s9lh9sjqlhkimcj.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1sdu0xc2zj3ogfc4.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.1sewonzr91mdxhzq.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.23094wz4lqxtub4c.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.24qbh8iz0hb6akub.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.2gozprhbiau1h5tv.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.2jjtv834hh6g35wt.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.2qdknd8xeyqmj6xy.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.302gmypdha4amu41.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.35p7e9uatlzfm12i.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3a5a86odl2k4pxgh.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3elm2xtgoffnelem.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3ezzcmsy1pm6s8qn.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3kq0d0ivdlbpqzoc.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3o4inmy94c59fw98.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3slnr0ksmu0qzji.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3v5jo015yhwju85c.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.3w5004f6zapr3gc3.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.43opa3b4t6upfx8q.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4h2luqi3rznum427.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4na3iqhjq7dqyjh5.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4r5rjf67ep5whxyp.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4sb0blu3c7dboumh.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4v84uhvp2lncgd48.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.4veuwhxsrp8ovsd5.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.51pafijk7hdye2wt.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.58g0xlbxm1cvqznu.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.58nq3d2ol0z88g62.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.59rmh1c7mv8nln58.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.5cunheaj9j7uxycw.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.fqsnl9dx13gip3d.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.margkqfb3o9ljbg.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.w6drbvgvurwy5kc.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.y6kqyi796zbibxy.rcgu.o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd.2n78lmb8hn88evxs.rcgu.o" "-Wl,--as-needed" "-L" "/home/iam/Work/guesswork/native/bdd/target/debug/deps" "-L" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libtest-d109504c51163197.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgetopts-072200a57e86c02b.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunicode_width-8d3632681791e828.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_std-00904b65f259c601.rlib" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/libinventory-683dfa32267fab93.rlib" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler_sys-79cbf449ea9b9c30.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d5189b81a4fa4d36.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-6a4779412a873200.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libobject-c88c426dd6780435.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-e74540b31113a555.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-8751b61bd13c15cf.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-a8b99dba9f449259.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-f0068d76172a0372.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-c16dfaf47799564e.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-bfa26dd63e299db5.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-75a2330a693e738f.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-76779dce1f7ab63d.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libadler-01c5cc588623cb35.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-07bb9745ec737292.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-6eacdcc91004cefb.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-ae2488b58226c836.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-52acaddcaaba04c6.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-326b78eac9ecd050.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcore-307ebf19f0f13d30.rlib" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-d9076ee5964191bf.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/home/iam/.rustup/toolchains/1.79-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/home/iam/Work/guesswork/native/bdd/target/debug/deps/bdd-b304eda6ad62a9fd" "-Wl,--gc-sections" "-pie" "-Wl,-z,relro,-z,now" "-nodefaultlibs"
  = note: /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.0.rcgu.o): in function `rustler::env::OwnedEnv::new':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/env.rs:211: undefined reference to `enif_alloc_env'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.0.rcgu.o): in function `<rustler::env::OwnedEnv as core::ops::drop::Drop>::drop':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/env.rs:321: undefined reference to `enif_free_env'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.3.rcgu.o): in function `rustler::term::Term::in_env':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/term.rs:59: undefined reference to `enif_make_copy'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.5.rcgu.o): in function `rustler::codegen_runtime::NifReturned::apply':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/codegen_runtime.rs:80: undefined reference to `enif_schedule_nif'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.6.rcgu.o): in function `rustler_sys::rustler_sys_api::enif_get_int64':
          /home/iam/Work/guesswork/native/bdd/target/debug/build/rustler_sys-fc774a4fac6fe7dc/out/nif_api.snippet:562: undefined reference to `enif_get_long'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.6.rcgu.o): in function `rustler_sys::rustler_sys_api::enif_make_int64':
          /home/iam/Work/guesswork/native/bdd/target/debug/build/rustler_sys-fc774a4fac6fe7dc/out/nif_api.snippet:552: undefined reference to `enif_make_long'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.6.rcgu.o): in function `rustler::wrapper::atom::make_atom':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/wrapper/atom.rs:6: undefined reference to `enif_make_atom_len'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.6.rcgu.o): in function `rustler::wrapper::tuple::make_tuple':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/wrapper/tuple.rs:16: undefined reference to `enif_make_tuple_from_array'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.7.rcgu.o): in function `rustler::wrapper::exception::raise_exception':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/wrapper/exception.rs:13: undefined reference to `enif_raise_exception'
          /usr/bin/ld: /home/iam/Work/guesswork/native/bdd/target/debug/deps/librustler-4a12d19cda660998.rlib(rustler-4a12d19cda660998.rustler.10bc91dbd542cda0-cgu.7.rcgu.o): in function `rustler::wrapper::exception::raise_badarg':
          /home/iam/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustler-0.34.0/src/wrapper/exception.rs:26: undefined reference to `enif_make_badarg'
          collect2: error: ld returned 1 exit status
          
  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)

error: could not compile `bdd` (lib test) due to 1 previous error

Note that cargo build works just fine.

[filmor]

If you want to test things that use actual NIF functionality, you have to test them from a running BEAM (eg. using ExUnit), as that is where they are implemented. Rustler itself just links to them.

[denumerate]

Ideally I just want to test my crate, not the beam pieces. I've done this in earlier versions (I just confirmed that 0.32.1 also works). I'm perfectly okay testing in the elixir library as well, but there are internals I cant reach there.

[filmor]

Could you try 0.35? It should actually "work" now as long as you don't have any code path that calls an enif_* function under the hood. But that aside, I agree with @evnu's suggestion to split the crate up. We could theoretically implement a "mini-BEAM" backend to use in tests, if someone is bored :)

[evnu]

We could theoretically implement a "mini-BEAM" backend to use in tests, if someone is bored :)

@hansihe started that some time ago in the mock_rt branch, but I can't find that branch here anymore. I have a copy on my fork though (I dabbled a bit with it, but never got to spend more time on it), see https://github.com/evnu/rustler/tree/mock_rt

That would still be a very nice thing to have :)

[denumerate]

0.35 works! Thank you. If I run into problems later I'll split up the crate. Should the documentation be updated to indicate this might be needed? The error wasn't exactly clear.

[filmor]

Not really, this still just works "accidentally". As soon as you are calling one of the real enif functions, you'll be invoking undefined behaviour and the process will die with a segfault. To really make testing the crate on its own sensible, we'll have to do something like this mock-rt backend and default to it in tests.

[evnu]

What can work quite well is to split your crate into two (or more) crates, where one crate is only used to expose the internals to BEAM. Then you can run cargo test for the crates which do not depend on any BEAM internals.