isk-daemon: Content-based image database server

The roadmap for the upcoming months including the major milestones is as follows. Bug fixes shall be available immediately as intermediary releases.

Release 0.7 – March/2010

1. Basic support for a cluster of daemons, improving scalability and performance. See more details on the initial cluster architecture.
2. Support for cluster configuration on web admin interface.
3. Improved support for multiple database spaces on the web admin interface.
4. Optionally save image filenames associated to imported images.
5. Alternative querying modes: by average color and improved flexibility for similarity queries (parameters for the weight given to color and shape similarity)
6. Improvements to Database management
7. Command to remove databases
8. Database access statistics
9. Documentation for using isk-daemon modules as a library for building image similarity applications (so in a sense isk-daemon would be basically an XML-RPC/SOAP/POX frontend to this library)
10. On Windows, image filenames with extended characters won’t get imported
11. saveDbAs() is not remembering the supplied filename, so further calls to saveDb() will save to a file named “not yet saved” instead of the previous one.
12. allow batch operations in order to minimize number of remote calls during normal operation
13. addMultipleImages
14. removeAll
15. removeIdRange
16. queryIDs

Release 0.8 – December/2010

1. Caching mechanism for improved performance and lower network usage (memcached support and bloom filters for image id exchange between server instances)
2. Improved network usage for cluster synchronization
3. Auto-discovery for cluster instances, so cluster instances don’t need to know by configuration time which other instances are available on the local network. Failover should then be completely transparent.
4. Support for querying based on signature processed at client-side, enabling web-based search by sketch. One example sketch applet shall be provided.
5. Improved API examples
6. Improved image querying operatios to the web admin interface, showing image thumbnails for results.
7. UTF-8 image filename support
8. design and implement REST interface
9. write pydocs for keyword-related methods
10. fix random kwd query bug
11. implement deleteImage method
12. more admin screenshots to the website and documentation
13. prettify C++ code and improve documentation/comments
14. references on documentation to POX (plain old XML) should be rephrased as XML-POST, POX-over-http or something like that to make terminology more clear
15. rerun all tests and sample clients, compose test suites
16. restructure imgdb.cpp into modules (major feature sets)
17. handle remote exceptions properly
18. more descriptive return codes for image management operations

Release 0.9 – June/2011

1. Support for image classification based on content similarity. The API would be extended to provide a method for querying which group an image belongs to and for training the internal classification engine by providing a group on the moment an image is added to the system. This should be based on some heuristic for determining set membership.

Release 1.0 – October/2011

1. segment video into scenes and index each scene as being just another image on database.
2. reuse code from VideoQuery
3. video support for some codecs (mpeg2, xvid, divx) and formats (mpg, mov, avi)

isk-daemon is an opensource standalone server or library capable of adding content-based (visual) image querying to any image related website or software.

Learn more about it on the main topics at the left sidebar.

The image database has a built-in web-based administration interface that can listen on a configurable port.

Here are some screenshots:

Similarity database statistics:

Adding images to the database using the built-in web admin interface:

API test example (querying for images similar to a specified one):

If you have interest on having the latest demo version working on your environment/web application, please don’t hesitate in contacting us with any problems during integration.

We are completely open to discuss over the improvements the demo version would need to better support your application functional and non-functional requirements. Please refer to the development roadmap and support area.

Installation

• Requirements
  • Linux: The server was compiled on Ubuntu Dapper Linux, linking against ImageMagick, so these are the packages you should have installed on the test machine:
    • python 2.5
    • libmagick
    • libmagick++
  • Windows: The following must be installed:
    • Python 2.5 or later.
    • ImageMagick-6.3.5-5-Q8-windows-dl (on the setup wizard, remember to check the option “Update executable search path”)

For both Linux and Windows: Just unzip (or untar for the Linux version: something like tar zxvf isk-daemon.tar.gz) the latest release file inside an empty directory.

Running the server

From the root of the directory where you extracted the latest release zipped file, run

python isk-daemon.py

Windows users must make sure python.exe (located by default at C:\Python25) is on the environment path or else keep the PATH variable intact and run “C:\Python25\python isk-daemon” instead.

In case you run into some import problems please don’t hesitate in getting in contact in order to figure out what is wrong or to request a compiled version for another linux distribution.

If all goes well, you should be able to point your browser to http://localhost:31128/ for some database statistics and configuration options.

After starting up, the XML+HTTP interface for sending commands would be available at http://localhost:31128/isk and the XML-RPC one at http://localhost:31128/RPC

Daemon config is at settings.py (located at the root dir where you extracted). Edit this file at will and restart the daemon.

The default configuration is to persist the database to disk every 2 minutes, but you can always force a save using an option on the admin web interface or using the API itself.

Common problems

If you get an ImportError related to _imgdb.so, you will need to compile the C++ imgdb module for your server architecture.

These are the basic features for the server side daemon:

• Query for images similar to one already indexed by the database, returning a similarity degree for the images on database that most resemble the target query image.
• Query for images similar to one described by its signature. A client-side widget may generate such signature from what a user sketched and submit it to the daemon.
• XML+HTTP interface for easy integration with other web and desktop or rich-client applications
• Fast indexing of images one-by-one or in batch
• Quickly remove images from database one-by-one or in batch
• Key-based security for API users
• Built-in web-based admin interface with statistics and ad-hoc maintenance commands/API testing
• Optimized image processing code implemented in C++

More upcoming features can be found on the development roadmap.