Skip to content

This transformer is an implementation of TellMeFirst as a Fusepool Transformer. It takes a plain text as input and responds with a JSON containing DBPedia URIs with a score value, representing the main topics of the input text.

Notifications You must be signed in to change notification settings

DavideAllavena/p3-tmf-transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

TellMeFirst

This transformer is an implementation of TellMeFirst as a Fusepool Transformer. It takes a plain text as input and responds with a JSON containing DBPedia URIs with a score value, representing the main topics of the input text.

More info about the TellMeFirst project: http://tellmefirst.polito.it. More info about Fusepool P3: https://github.com/fusepoolP3.

Compiling and Running

Compile the project running the command

mvn install

Start the component with

java -cp ./target/transformer-tmf-1.0-jar-with-dependencies.jar eu.fusepool.p3.transformer.tmf.TMFTransformer 

You can use the transformer for example with curl:

curl -XPOST -H 'Content-Type: text/plain' -d 'Your plain text here' 'http://localhost:7101'

The tranformer will respond with a JSON with this structure:

{
  "@service": "Classify",
  "Resources":   [
        {
      "@uri": "http://dbpedia.org/...",
      "@label": "",
      "@title": "",
      "@score": ""
      "@mergedTypes": "",
      "@image": ""
    },
    ...
  ]
}

Making TMFTransformer Asynchronous

TMFTransformer is a synchronous transformer i.e., it does not reply to the client until it is done transforming. if you need it asynchronous a very simple way to make TMFTransformer asynchronous is to change.

isLongRunning so that it always returns true:

@Override public boolean isLongRunning() { return true; }

This will cause our implementation to be wrapped inside an instance of LongRunningTransformerWrapper by the runtime, effectively making it asynchronous. Now, when we post the transformation with curl, instead of an immediate response, we get:

curl -i -XPOST -H 'Content-Type: text/plain' -d 'Your plain text here' 'http://localhost:7101'

Will return something like:

HTTP/1.1 202 Accepted
Location: /job/f3b6317f-ad60-4f75-b8f1-00a7f2ec4602

which means, as per the asynchronous API, that the transformer is now working on the transformation, and the client is free to go about its business in the meantime. The path /job/f3b6317f-ad60-4f75-b8f1-00a7f2ec4602 represents the transformation job, and it can be polled by issuing a GET request:

curl -i -XGET 'http://localhost:8080/job/f3b6317f-ad60-4f75-b8f1-00a7f2ec4602'

About

This transformer is an implementation of TellMeFirst as a Fusepool Transformer. It takes a plain text as input and responds with a JSON containing DBPedia URIs with a score value, representing the main topics of the input text.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages