AnsweredAssumed Answered

mapr-streams-python installation failed

Question asked by VivekG on Jul 19, 2018

Hi,

We are trying to run mapr streams from python on a single node cluster

Ref: GitHub - mapr-demos/mapr-streams-sample-python: Sample programs in Python for MapR Streams compatible with Apache Kafka … 

Mapr Version 5.2.2

Python 3.6

While installing  mapr-streams-python==0.9.2 got the following issue, and the installation fails.

 

 

Complete output from command /home/mapr/hadoop/BBI/DEV_VAL/SparkStreaming/spark/PySpark/StreamingMaprDB/maprstreams/bin/python -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-o_2e0dpj/mapr-streams-python/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/pip-wheel-uyn9ekbj --python-tag cp36:
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.6
creating build/lib.linux-x86_64-3.6/mapr_streams_python
copying mapr_streams_python/__init__.py -> build/lib.linux-x86_64-3.6/mapr_streams_python
creating build/lib.linux-x86_64-3.6/mapr_streams_python/kafkatest
copying mapr_streams_python/kafkatest/__init__.py -> build/lib.linux-x86_64-3.6/mapr_streams_python/kafkatest
copying mapr_streams_python/kafkatest/verifiable_producer.py -> build/lib.linux-x86_64-3.6/mapr_streams_python/kafkatest
copying mapr_streams_python/kafkatest/verifiable_client.py -> build/lib.linux-x86_64-3.6/mapr_streams_python/kafkatest
copying mapr_streams_python/kafkatest/verifiable_consumer.py -> build/lib.linux-x86_64-3.6/mapr_streams_python/kafkatest
running build_ext
building 'mapr_streams_python.cimpl' extension
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/mapr_streams_python
creating build/temp.linux-x86_64-3.6/mapr_streams_python/src
gcc -pthread -B /opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/mapr/hadoop/BBI/DEV_VAL/SparkStreaming/spark/PySpark/StreamingMaprDB/maprstreams/include -I/opt/anaconda3/include/python3.6m -c mapr_streams_python/src/mapr_streams_python.c -o build/temp.linux-x86_64-3.6/mapr_streams_python/src/mapr_streams_python.o
In file included from mapr_streams_python/src/mapr_streams_python.c:17:
mapr_streams_python/src/mapr_streams_python.h:21:32: error: librdkafka/rdkafka.h: No such file or directory
In file included from mapr_streams_python/src/mapr_streams_python.c:17:
mapr_streams_python/src/mapr_streams_python.h:88: error: expected ‘)’ before ‘err’
mapr_streams_python/src/mapr_streams_python.h:89: error: expected ‘)’ before ‘err’

When mapr-streams-python==0.11.0 is set it gets installled however the producer.py fails saying couldn't find the module mapr_streams_python

Traceback (most recent call last):
File "producer.py", line 2, in <module>
from mapr_streams_python import Producer
ModuleNotFoundError: No module named 'mapr_streams_python'

Can someone please help us on this?

Outcomes