This is a toy Chatbot written in Python 3.5 with a MySQL database backend. The code is mainly based on this blog-post: http://rodic.fr/blog/python-chatbot-1/
The logic is very simple - the ChatBot stores bag-of-word associations for responses to a previous sentence and uses this to try to match future responses.
This is not aimed at any real practical task, it is just a framework for experimenting with and developing further.
Core
chatbot.py- main ChatBot libraryutils.py- generic function utilities used by ChatBot (config, DB conn etc)botserver.py- Multi-Threaded server to allow multiple clients to connect to the ChatBot via network socketssimpleclient.py- Simple network sockets client to connect tobotserver
Setup and Test
config.ini- sample config file to copy into the ./config directorypwdutil.py- store an encoded password for connecting to the database schemasetupDatabase.py- drop and recreate the database tables (existing data gets lost)pingDB.py- test the database configuration: create test table, insert data, query it, drop the test table.dataDump.py- Dump out a database table in CSV formatdataLoad.py- Load a database table in CSV format
Within source-code working directory, create the following sub-directories:
./config
./dump
config file
In the config directory, create a config.ini file. Example contents:
[MySQL]
server: localhost
dbuser: simplebot
dbname: simplebot
dbcharset: utf8mb4
The [MySQL] Header specifies the MySQL database configuration (and must have this label).
Database User Create a dedicated database for the SimpleBot data-store.
As root user in MySQL, create a dedicated MySQL user for the SimpleBot to connect to the datastore:
CREATE USER 'simplebot'@'localhost' IDENTIFIED BY '<myPassword123>';
GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,DROP on simplebot.*
TO 'simplebot'@'localhost';
GRANT CREATE TEMPORARY TABLES on simplebot.*
TO 'simplebot'@'localhost';
The user-name must match the user configured in the ChatBot config.ini file.
Replace localhost with the remote host that the ChatBot will be accessing the mySQL database from.
Set an appropriate password; this will need to be initialised (stored locally in encoded form) for the ChatBot later on (see the next section of this README).
Initialisation of Database Password for ChatBot
Password authentication details for the ChatBot to access the MySQL database are stored locally. To avoid storing the actual password in clear-text the password is stored in encoded form.
A separate file called
./config/.key
must be created in the config sub-directory with a single key phrase in it and no other text or characters - i.e.
$ echo "thisIsSecret" > ./.key
$ chmod 400 .key
(this is NOT the database password). Set appropriate file permissions on this file.
When the .key file is in place, initialise password access to the remote MySQL database using
python pwdutil.py -s password
where "password" is the appropriate real password for the ChatBot MySQL database user account (so this is not the key phrase set above).
NOTE - the approach taken here is not very secure. It is better than storing the database password in clear text, but is still very limited and this configuration is not suitable for sensitive data.
Test Database Configuration
A simple pingDB.py script is provided to test database access and base functionality.
The script connects as the configured mySQL user, creates a table "bot_test_tab", inserts a row, selects it back out and then drops the table.
Expected output is below:
$ python ./pingDB.py
C:\Python35\lib\site-packages\pymysql\cursors.py:323: Warning: (1051, "Unknown table 'simplebot.bot_test_tab'")
self._do_get_result()
execute drop_test_tab Args: None Response 0
execute create_test_tab Args: None Response 0
execute insert_test_tab Args: ('a', 1) Response 1
execute select_test_tab Args: 1 Response 1
execute drop_test_tab Args: None Response 0
Setup the Database Schema
Run the python script setupDatabase.py to create the database schema. EG:
$ python setupDatabase.py
Configuring Tables for database configuration:
Server: localhost
DB-User: simplebot
DB-Name: simplebot
Continue? [Y/n] y
Connecting to database... connected.
Creating words table:
DROP TABLE IF EXISTS words
CREATE TABLE words ( hashid VARCHAR(16) COLLATE utf8_general_ci UNIQUE, word VARCHAR(64) COLLATE utf8_general_ci UNIQUE )
...
(etc,etc)
...
Done.
The ChatBot can be started in single-user mode as follows:
python chatbot.py
The chatbot can be started with a multi-threaded server scheduler (botserver.py) that listens for connections on a TCP port. This is a very simple "bare-bones" multi session framework with no authentication and just relying on TCP sockets for connection.
Remote TCP Socket Connection requests are given a thread and their own session connection.
The botserver gives each session a connection to the shared database server.
Start the server
Before starting the server, check the section in the ./config/config.ini file for configuring the server, EG:
[Server]
listen_host: 0.0.0.0
tcp_socket: 9999
listen_queue: 10
The default settings are fine for most cases. To start the server run
nohup python3.5 botserver.py &
Connect a remote client
To connect a remote client, make sure the port the server is listening to is allowed through the firewall (or use SSH tunneling).
Copy the simpleclient.py file to the remote client host.
Start the client by running:
python simpleclient.py -a 192.168.0.99 -p 9999
(where the ChatBot Server host IP address or host-alias is supplied for the "-a" arg and ChatBot Server Port is supplied for the -p arg)
There is room for improvement but we get a sort of conversation going:
Bot> Hello!
>>> Hi there
Bot> How are you?
>>> I am great.
Bot> How are you?
>>> Very well thanks.
Bot> Sorry I don't know what to say
Bot> Please can you train me - enter a response for me to learn (Enter to Skip)
>>> That is good to hear.
Bot> Thanks I've noted that
>>> How are you?
Bot> I am in a great mood
>>> Cool.
Bot> Sorry I don't know what to say
Bot> Please can you train me - enter a response for me to learn (Enter to Skip)
>>>
Bot> OK, moving on...
>>> What is a cat?
Bot> Sorry I don't know what to say
Bot> Please can you train me - enter a response for me to learn (Enter to Skip)
>>> A cat is a furry animal that chases mice
Bot> Thanks I've noted that
Bot> How are you?
>>> Very well thanks
Bot> That is great to hear
>>> quit
$