Splunk Base : SplunkGeneral : #4138

fail to set up MySQLdb

dianbo — Fri, 26 Mar 2010 00:47:11 PDT

How to use relative address in subprocess.Popen. I used the following code but it failed.
p = subprocess.Popen(['/usr/bin/python', './dbtestlookup.py', cityf, countryf], .......

Thanks.

fail to set up MySQLdb

dianbo — Wed, 17 Mar 2010 08:31:51 PDT

thank you very much.
i am a beginner of Python. thank you for your detailed explanation.

fail to set up MySQLdb

araitz — Fri, 12 Mar 2010 07:42:59 PST

Per the answers post, did you unset the required env variables? It does not look like you did based on above.

You will probably need to do something like this:


#!/opt/splunk/bin/python
import os,sys,subprocess

os.unsetenv("PYTHONPATH")
os.unsetenv("PATH")
os.unsetenv("LD_LIBRARY_PATH")

p = subprocess.Popen(['/usr/bin/python', '/opt/splunk/etc/apps/search/bin/dbtestlookup.py', cityf, countryf],stdin=subprocess.PIPE,stdout=subprocess.PIPE)

so = p.communicate("".join(sys.stdin.readlines()))
for o in so:
  if o:
    print o

fail to set up MySQLdb

dianbo — Fri, 12 Mar 2010 02:17:12 PST

Hi,

I tried the following code but did not see the lookup result.
//dbtestlookupwrapper.py
mycmd_ = ['/usr/bin/python', '/opt/splunk/etc/apps/search/bin/dbtestlookup.py', cityf, countryf]
subprocess.Popen(mycmd_, stdin = None, stdout = None, stderr = None, shell = False).wait()

2 questions:

how to set relative address for the python script?
where is the error information log file when failed to execute lookup script?

Thanks & regards.
Dianbo

fail to set up MySQLdb

araitz — Thu, 11 Mar 2010 09:07:19 PST

According to the Splunk Answers thread above, it is not supported to install 3rd party python modules within Splunk. The best practice is to use a wrapper script such as is described in Amrit's post on that thread.

fail to set up MySQLdb

dianbo — Thu, 11 Mar 2010 08:08:59 PST

it is the same.

[root@localhost bin]# ./splunk cmd /local/dl/setuptools-0.6c11-py2.6.egg Traceback (most recent call last): File "", line 1, in File "/local/dl/setuptools-0.6c11-py2.6.egg/setuptools/init.py", line 2, in File "/local/dl/setuptools-0.6c11-py2.6.egg/setuptools/extension.py", line 2, in File "/local/dl/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 5, in File "/local/dl/setuptools-0.6c11-py2.6.egg/setuptools/command/init.py", line 13, in ImportError: No module named command.bdist

[root@localhost bin]# ./splunk cmd /local/dl/MySQL_python-1.2.3c1-py2.6-linux-i686.egg couldn't run "/local/dl/MySQL_python-1.2.3c1-py2.6-linux-i686.egg": Exec format error

fail to set up MySQLdb

rataide — Wed, 10 Mar 2010 04:16:25 PST

Try ./splunk cmd python setup.py build from http://answers.splunk.com/questions/8/can-i-add-python-modules-to-the-splunk-environment

Regards,

Rui

fail to set up MySQLdb

dianbo — Wed, 10 Mar 2010 00:58:16 PST

Hi,

I want to do lookup from mysql database. the python in my linux is python 2.3, and i installed splunk 3.4 and splunk 4.0, so there are 3 pythons in the server -- 2.3, 2.5 and 2.6.

I want to append mysqldb to python 2.6. The following are the steps and console messages.
cd MySQL-python-1.2.3c1

python2.6 setup.py build
ImportError: No module named setuptools

sh setuptools-0.6c11-py2.6.egg
ImportError: No module named command.bdist

Anyone can help? Thanks,

//Note: it goes well when install setuptools and mysqldb to the local python 2.3.

Dianbo