isk-daemon: Content-based image database server

The roadmap for the upcoming months including the major milestones is as follows. Bug fixes shall be available immediately as intermediary releases.

Release 0.7 - March/2008
Basic support for a cluster of daemons, improving scalability and performance. See more details on the initial cluster architecture.
Support for cluster configuration on web admin interface.
Improved support for multiple database spaces on the web admin interface.
Optionally save image filenames associated to imported images.
Alternative querying modes: by average color and improved flexibility for similarity queries (parameters for the weight given to color and shape similarity)
Improvements to Database management
Command to remove databases
Database access statistics
Documentation for using isk-daemon modules as a library for building image similarity applications (so in a sense isk-daemon would be basically an XML-RPC/SOAP/POX frontend to this library)
On Windows, image filenames with extended characters won’t get imported
saveDbAs() is not remembering the supplied filename, so further calls to saveDb() will save to a file named “not yet saved” instead of the previous one.
allow batch operations in order to minimize number of remote calls during normal operation
addMultipleImages
removeAll
removeIdRange
queryIDs

Release 0.8 - June/2008
Caching mechanism for improved performance and lower network usage (memcached support and bloom filters for image id exchange between server instances)
Improved network usage for cluster synchronization
Auto-discovery for cluster instances, so cluster instances don’t need to know by configuration time which other instances are available on the local network. Failover should then be completely transparent.
Support for querying based on signature processed at client-side, enabling web-based search by sketch. One example sketch applet shall be provided.
Improved API examples
Improved image querying operatios to the web admin interface, showing image thumbnails for results.
UTF-8 image filename support

Release 0.9 - August/2008
Support for image classification based on content similarity. The API would be extended to provide a method for querying which group an image belongs to and for training the internal classification engine by providing a group on the moment an image is added to the system.

Release 1.0 - September/2008
video support
codecs
mpeg2
xvid
divx
formats
mpg
mov
avi
segment video into scenes and index each scene as being just another image on database

isk-daemon is an opensource standalone server or library capable of adding content-based (visual) image querying to any image related website or software.

Learn more about it on the main topics at the left sidebar.

The image database has a built-in web-based administration interface that can listen on a configurable port.

Here are some screenshots:

Similarity database statistics:

Adding images to the database using the built-in web admin interface:

API test example (querying for images similar to a specified one):

If you have interest on having the latest demo version working on your environment/web application, please don’t hesitate in contacting us with any problems during integration.

We are completely open to discuss over the improvements the demo version would need to better support your application functional and non-functional requirements. Please refer to the development roadmap and support area.

Installation

• Requirements
  • Linux: The server was compiled on Ubuntu Dapper Linux, linking against ImageMagick, so these are the packages you should have installed on the test machine:
    • python 2.5
    • libmagick
    • libmagick++
  • Windows: The following must be installed:
    • Python 2.5 or later.
    • ImageMagick-6.3.5-5-Q8-windows-dl (on the setup wizard, remember to check the option “Update executable search path”)

For both Linux and Windows: Just unzip (or untar for the Linux version: something like tar zxvf isk-daemon.tar.gz) the latest release file inside an empty directory.

Running the server

From the root of the directory where you extracted the latest release zipped file, run

python isk-daemon.py

Windows users must make sure python.exe (located by default at C:\Python25) is on the environment path or else keep the PATH variable intact and run “C:\Python25\python isk-daemon” instead.

In case you run into some import problems please don’t hesitate in getting in contact in order to figure out what is wrong or to request a compiled version for another linux distribution.

If all goes well, you should be able to point your browser to http://localhost:31128/ for some database statistics and configuration options.

After starting up, the XML+HTTP interface for sending commands would be available at http://localhost:31128/isk and the XML-RPC one at http://localhost:31128/RPC

Daemon config is at settings.py (located at the root dir where you extracted). Edit this file at will and restart the daemon.

The default configuration is to persist the database to disk every 2 minutes, but you can always force a save using an option on the admin web interface or using the API itself.

These are the basic features for the server side daemon:

• Query for images similar to one already indexed by the database, returning a similarity degree for the images on database that most resemble the target query image.
• Query for images similar to one described by its signature. A client-side widget may generate such signature from what a user sketched and submit it to the daemon.
• XML+HTTP interface for easy integration with other web and desktop or rich-client applications
• Fast indexing of images one-by-one or in batch
• Quickly remove images from database one-by-one or in batch
• Key-based security for API users
• Built-in web-based admin interface with statistics and ad-hoc maintenance commands/API testing
• Optimized image processing code implemented in C++

More upcoming features can be found on the development roadmap.