Node-rdkafka: Installation is broken

[idangozlan]

Environment Information

• OS: MAC 10.14
• Node Version: v8.11.1
• NPM Version: 5.6.0
• node-rdkafka version : 2.4.2

Steps to Reproduce
npm install node-rdkafka@latest

Log

gcc -L/Users/idan/myapp/node_modules/node-rdkafka/build/deps -shared -dynamiclib -Wl,-install_name,/Users/idan/myapp/node_modules/node-rdkafka/build/deps/librdkafka.1.dylib rdkafka.o rdkafka_broker.o rdkafka_msg.o rdkafka_topic.o rdkafka_conf.o rdkafka_timer.o rdkafka_offset.o rdkafka_transport.o rdkafka_buf.o rdkafka_queue.o rdkafka_op.o rdkafka_request.o rdkafka_cgrp.o rdkafka_pattern.o rdkafka_partition.o rdkafka_subscription.o rdkafka_assignor.o rdkafka_range_assignor.o rdkafka_roundrobin_assignor.o rdkafka_feature.o rdcrc32.o crc32c.o rdmurmur2.o rdaddr.o rdrand.o rdlist.o tinycthread.o rdlog.o rdstring.o rdkafka_event.o rdkafka_metadata.o rdregex.o rdports.o rdkafka_metadata_cache.o rdavl.o rdkafka_sasl.o rdkafka_sasl_plain.o rdkafka_interceptor.o rdkafka_msgset_writer.o rdkafka_msgset_reader.o rdkafka_header.o rdkafka_admin.o rdkafka_aux.o rdkafka_background.o rdvarint.o rdbuf.o rdunittest.o rdkafka_sasl_cyrus.o rdkafka_sasl_scram.o snappy.o rdgz.o rdhdrhistogram.o rdkafka_lz4.o xxhash.o rddl.o rdkafka_plugin.o -o librdkafka.1.dylib -lsasl2 -L/usr/local/Cellar/openssl/1.0.2p/lib -lssl -L/usr/local/Cellar/lz4/1.8.3/lib -llz4 -lm -lz -ldl -lpthread
Undefined symbols for architecture x86_64:
  "_CRYPTO_cleanup_all_ex_data", referenced from:
      _rd_kafka_transport_ssl_term in rdkafka_transport.o
  "_CRYPTO_num_locks", referenced from:
      _rd_kafka_transport_ssl_init in rdkafka_transport.o
  "_CRYPTO_set_id_callback", referenced from:
      _rd_kafka_transport_ssl_term in rdkafka_transport.o
      _rd_kafka_transport_ssl_init in rdkafka_transport.o
  "_CRYPTO_set_locking_callback", referenced from:
      _rd_kafka_transport_ssl_term in rdkafka_transport.o
      _rd_kafka_transport_ssl_init in rdkafka_transport.o
  "_ERR_clear_error", referenced from:
      _rd_kafka_transport_send in rdkafka_transport.o
      _rd_kafka_transport_recv in rdkafka_transport.o
      _rd_kafka_transport_io_serve in rdkafka_transport.o
  "_ERR_error_string_n", referenced from:
      _rd_kafka_ssl_error in rdkafka_transport.o
  "_ERR_get_error_line_data", referenced from:
      _rd_kafka_ssl_error in rdkafka_transport.o
  "_ERR_peek_error", referenced from:
      _rd_kafka_transport_ssl_io_update in rdkafka_transport.o
  "_ERR_remove_thread_state", referenced from:
      _rd_kafka_broker_thread_main in rdkafka_broker.o
  "_EVP_DecodeBlock", referenced from:
      _rd_kafka_sasl_scram_fsm in rdkafka_sasl_scram.o
  "_EVP_EncodeBlock", referenced from:
      _rd_kafka_sasl_scram_build_client_final_message in rdkafka_sasl_scram.o
  "_EVP_PKEY_free", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_EVP_PKEY_new", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_EVP_sha1", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_EVP_sha256", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_EVP_sha512", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_HMAC", referenced from:
      _rd_kafka_sasl_scram_Hi in rdkafka_sasl_scram.o
      _rd_kafka_sasl_scram_HMAC in rdkafka_sasl_scram.o
  "_OPENSSL_add_all_algorithms_noconf", referenced from:
      _rd_kafka_transport_ssl_init in rdkafka_transport.o
  "_PKCS12_free", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_PKCS12_parse", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_SHA1", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_SHA256", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_SHA512", referenced from:
      _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o
  "_X509_STORE_set_flags", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_X509_free", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
      _rd_kafka_transport_io_serve in rdkafka_transport.o
  "_X509_new", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_X509_verify_cert_error_string", referenced from:
      _rd_kafka_transport_io_serve in rdkafka_transport.o
  "_d2i_PKCS12_fp", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
  "_sk_pop_free", referenced from:
      _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[2]: *** [librdkafka.1.dylib] Error 1
make[1]: *** [libs] Error 2
make: *** [11a9e3388a67e1ca5c31c1d8da49cb6d2714eb41.intermediate] Error 2
rm 11a9e3388a67e1ca5c31c1d8da49cb6d2714eb41.intermediate
gyp ERR! build error
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/Users/idan/.nvm/versions/node/v8.11.1/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:262:23)
gyp ERR! stack     at emitTwo (events.js:126:13)
gyp ERR! stack     at ChildProcess.emit (events.js:214:7)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:198:12)
gyp ERR! System Darwin 18.0.0
gyp ERR! command "/Users/idan/.nvm/versions/node/v8.11.1/bin/node" "/Users/idan/.nvm/versions/node/v8.11.1/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /Users/idan/myapp/node_modules/node-rdkafka
gyp ERR! node -v v8.11.1
gyp ERR! node-gyp -v v3.8.0
gyp ERR! not ok
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] install: `node-gyp rebuild`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /Users/idan/.npm/_logs/2018-11-01T22_59_36_879Z-debug.log

[idangozlan]

this:

export CPPFLAGS=-I/usr/local/opt/openssl/include
export LDFLAGS=-L/usr/local/opt/openssl/lib

fixed that.

[rosesandhello]

This is still an issue.

macOS 10.14.2
MacBook Pro (15-inch, 2016)

Undefined symbols for architecture x86_64: "_CRYPTO_cleanup_all_ex_data", referenced from: _rd_kafka_transport_ssl_term in rdkafka_transport.o "_CRYPTO_num_locks", referenced from: _rd_kafka_transport_ssl_init in rdkafka_transport.o "_CRYPTO_set_id_callback", referenced from: _rd_kafka_transport_ssl_term in rdkafka_transport.o _rd_kafka_transport_ssl_init in rdkafka_transport.o "_CRYPTO_set_locking_callback", referenced from: _rd_kafka_transport_ssl_term in rdkafka_transport.o _rd_kafka_transport_ssl_init in rdkafka_transport.o "_ERR_clear_error", referenced from: _rd_kafka_transport_send in rdkafka_transport.o _rd_kafka_transport_recv in rdkafka_transport.o _rd_kafka_transport_io_serve in rdkafka_transport.o "_ERR_error_string_n", referenced from: _rd_kafka_ssl_error in rdkafka_transport.o "_ERR_get_error_line_data", referenced from: _rd_kafka_ssl_error in rdkafka_transport.o "_ERR_peek_error", referenced from: _rd_kafka_transport_ssl_io_update in rdkafka_transport.o "_ERR_remove_thread_state", referenced from: _rd_kafka_broker_thread_main in rdkafka_broker.o "_EVP_DecodeBlock", referenced from: _rd_kafka_sasl_scram_fsm in rdkafka_sasl_scram.o "_EVP_EncodeBlock", referenced from: _rd_kafka_sasl_scram_build_client_final_message in rdkafka_sasl_scram.o "_EVP_PKEY_free", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_EVP_PKEY_new", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_EVP_sha1", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_EVP_sha256", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_EVP_sha512", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_HMAC", referenced from: _rd_kafka_sasl_scram_Hi in rdkafka_sasl_scram.o _rd_kafka_sasl_scram_HMAC in rdkafka_sasl_scram.o "_OPENSSL_add_all_algorithms_noconf", referenced from: _rd_kafka_transport_ssl_init in rdkafka_transport.o "_PKCS12_free", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_PKCS12_parse", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_SHA1", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_SHA256", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_SHA512", referenced from: _rd_kafka_sasl_scram_conf_validate in rdkafka_sasl_scram.o "_X509_STORE_set_flags", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_X509_free", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o _rd_kafka_transport_io_serve in rdkafka_transport.o "_X509_new", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_X509_verify_cert_error_string", referenced from: _rd_kafka_transport_io_serve in rdkafka_transport.o "_d2i_PKCS12_fp", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o "_sk_pop_free", referenced from: _rd_kafka_transport_ssl_ctx_init in rdkafka_transport.o ld: symbol(s) not found for architecture x86_64 clang: error: linker command failed with exit code 1 (use -v to see invocation) make[2]: *** [librdkafka.1.dylib] Error 1 make[1]: *** [libs] Error 2 make: *** [11a9e3388a67e1ca5c31c1d8da49cb6d2714eb41.intermediate] Error 2 rm 11a9e3388a67e1ca5c31c1d8da49cb6d2714eb41.intermediate

[idangozlan]

run this before running npm install:

export CPPFLAGS=-I/usr/local/opt/openssl/include
export LDFLAGS=-L/usr/local/opt/openssl/lib