Generative Service

The Generative Service API handles all integration with LLMs and generative content.

API SUBPATH: eva-generative-service

Pagination and Listing

Searches and paginates through expected Generative Service

GET/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service

Path parameters

orgUUID*string

A valid uuid of an organization

envUUID*string

A valid uuid of an environment

botUUID*string

The UUID of the bot whose entities you are searching

Query parameters

Response

200400401403404409422500

Ok

Body

application/json

totalPagesinteger (int32)

totalElementsinteger (int64)

sizeinteger (int32)

contentarray of GenerativeServiceFlowsDTO (object)

numberinteger (int32)

sortSort (object)

pageablePageableObject (object)

numberOfElementsinteger (int32)

firstboolean

lastboolean

emptyboolean

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

{
  "content": [
    {
      "generativeService": {
        "uuid": "text",
        "name": "text",
        "description": "text",
        "prompt": "text",
        "model": "text",
        "temperature": 0,
        "topP": 0,
        "presencePenalty": 0,
        "frequencyPenalty": 0,
        "responseVariableName": "text",
        "usesBlacklist": false,
        "blacklistWords": "text",
        "removed": false,
        "createdAt": "2024-05-04T07:17:52.622Z",
        "updatedAt": "2024-05-04T07:17:52.622Z",
        "updatedBy": "text",
        "createdBy": "text"
      },
      "flows": [
        {
          "uuid": "text",
          "name": "text"
        }
      ]
    }
  ],
  "sort": {
    "empty": false,
    "unsorted": false,
    "sorted": false
  },
  "pageable": {
    "sort": {
      "empty": false,
      "unsorted": false,
      "sorted": false
    },
    "paged": false,
    "unpaged": false
  },
  "first": false,
  "last": false,
  "empty": false
}

Searches (greedily) for any Generative Service names that exists in a bot, matching the typed term, left-to-right, and returns a list of Strings, ordered alphabetically.

GET/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/quicksearch

Path parameters

orgUUID*string

A valid organization Uuid

envUUID*string

A valid environment Uuid

botUUID*string

A valid bot uuid to search

Query parameters

Response

200400401403404409422500

Ok

Body

application/json

itemsstring

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/quicksearch', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

[
  "text"
]

Searches through all Generative Service recently used on a given bot to start a flow.

GET/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/list-on-flow

Path parameters

orgUUID*string

A valid uuid of an organization

envUUID*string

A valid uuid of an environment

botUUID*string

The UUID of the bot whose entities you are searching

Response

200400401403404409422500

Ok

Body

application/json

uuidstring

The Generative Service's String uuid.

namestring

The Generative Service's name.

modelstring

The Generative Service's model.

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/list-on-flow', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

[
  {
    "uuid": "text",
    "name": "text",
    "model": "text"
  }
]

CRUD Operations

Retrieves info from a specific given Generative Service.

GET/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}

Path parameters

orgUUID*string

A valid uuid of an organization

envUUID*string

A valid uuid of an environment

botUUID*string

The UUID of the bot whose entity you are searching belong to

uuid*string

The generativeService's uuid

Response

200400401403404409422500

Ok

Body

application/json

generativeServiceGenerativeServiceDTO (object)

A Structure representing all data of a Generative Service.

flowsarray of FlowResponseDTO (object)

A list of Flows associated to this Generative Service

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

{
  "generativeService": {
    "uuid": "text",
    "name": "text",
    "description": "text",
    "prompt": "text",
    "model": "text",
    "temperature": 0,
    "topP": 0,
    "presencePenalty": 0,
    "frequencyPenalty": 0,
    "responseVariableName": "text",
    "usesBlacklist": false,
    "blacklistWords": "text",
    "removed": false,
    "createdAt": "2024-05-04T07:17:52.622Z",
    "updatedAt": "2024-05-04T07:17:52.622Z",
    "updatedBy": "text",
    "createdBy": "text"
  },
  "flows": [
    {
      "uuid": "text",
      "name": "text"
    }
  ]
}

Creates a brand new Generative Service

POST/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service

Path parameters

orgUUID*string

A valid uuid of organization

envUUID*string

A valid uuid of environment

botUUID*string

A valid uuid of bot

Body

application/json

name*string

Name of this Generative Service.

descriptionstring

An optional description of this Generative Service.

promptstring

Actual prompt to be executed during AI generation when executing this service.

modelstring

AI Model to be used in this Generative Service.

temperaturenumber (double)

AI's temperature value for execution of this Generative Service.

maximumTokensinteger (int32)

Maximum tokens to be used during a single execution of this Generative Service.

topPnumber (double)

AI's topP value for execution of this Generative Service.

presencePenaltynumber (double)

AI's presence penalty value for execution of this Generative Service.

frequencyPenaltynumber (double)

AI's frequency penalty value for execution of this Generative Service.

responseVariableNamestring

Name of the variable in $hiddenContext this service will store it's result.

usesBlacklistboolean

Wether this execution should blacklist specific words.

blacklistWordsstring

A blacklist of comma-separated terms to be excluded from this service's generation.

Response

200400401403404409422500

Ok

Body

application/json

generativeServiceGenerativeServiceDTO (object)

A Structure representing all data of a Generative Service.

flowsarray of FlowResponseDTO (object)

A list of Flows associated to this Generative Service

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "name": "text"
    }),
});
const data = await response.json();

Response

{
  "generativeService": {
    "uuid": "text",
    "name": "text",
    "description": "text",
    "prompt": "text",
    "model": "text",
    "temperature": 0,
    "topP": 0,
    "presencePenalty": 0,
    "frequencyPenalty": 0,
    "responseVariableName": "text",
    "usesBlacklist": false,
    "blacklistWords": "text",
    "removed": false,
    "createdAt": "2024-05-04T07:17:52.622Z",
    "updatedAt": "2024-05-04T07:17:52.622Z",
    "updatedBy": "text",
    "createdBy": "text"
  },
  "flows": [
    {
      "uuid": "text",
      "name": "text"
    }
  ]
}

Updates a Generative Service.

PUT/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}

Path parameters

orgUUID*string

A valid uuid of an organization

envUUID*string

A valid uuid of an environment

botUUID*string

The UUID of the bot whose entity you are searching belong to

uuid*string

The generativeService's uuid

Body

application/json

name*string

Name of this Generative Service.

descriptionstring

An optional description of this Generative Service.

promptstring

Actual prompt to be executed during AI generation when executing this service.

modelstring

AI Model to be used in this Generative Service.

temperaturenumber (double)

AI's temperature value for execution of this Generative Service.

maximumTokensinteger (int32)

Maximum tokens to be used during a single execution of this Generative Service.

topPnumber (double)

AI's topP value for execution of this Generative Service.

presencePenaltynumber (double)

AI's presence penalty value for execution of this Generative Service.

frequencyPenaltynumber (double)

AI's frequency penalty value for execution of this Generative Service.

responseVariableNamestring

Name of the variable in $hiddenContext this service will store it's result.

usesBlacklistboolean

Wether this execution should blacklist specific words.

blacklistWordsstring

A blacklist of comma-separated terms to be excluded from this service's generation.

Response

200400401403404409422500

Ok

Body

application/json

generativeServiceGenerativeServiceDTO (object)

A Structure representing all data of a Generative Service.

flowsarray of FlowResponseDTO (object)

A list of Flows associated to this Generative Service

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}', {
    method: 'PUT',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "name": "text"
    }),
});
const data = await response.json();

Response

{
  "generativeService": {
    "uuid": "text",
    "name": "text",
    "description": "text",
    "prompt": "text",
    "model": "text",
    "temperature": 0,
    "topP": 0,
    "presencePenalty": 0,
    "frequencyPenalty": 0,
    "responseVariableName": "text",
    "usesBlacklist": false,
    "blacklistWords": "text",
    "removed": false,
    "createdAt": "2024-05-04T07:17:52.622Z",
    "updatedAt": "2024-05-04T07:17:52.622Z",
    "updatedBy": "text",
    "createdBy": "text"
  },
  "flows": [
    {
      "uuid": "text",
      "name": "text"
    }
  ]
}

Deletes a Generative Service. The Generative Service is disabled via the 'removed' parameter rather than deleted from the DB.

DELETE/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}

Path parameters

orgUUID*string

A valid uuid of organization

envUUID*string

A valid uuid of environment

botUUID*string

A valid uuid of bot

uuid*string

The generativeService's uuid

Response

200400401403404409422500

Ok

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/{uuid}', {
    method: 'DELETE',
    headers: {},
});
const data = await response.json();

Execution

The following section contains methods which are useable to test or simulate the cell's working.

Simulates a generative AI output.

POST/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/simulate

Path parameters

orgUUID*string

A valid uuid of organization

envUUID*string

A valid uuid of environment

botUUID*string

A valid uuid of bot

Body

application/json

name*string

Name of this Generative Service.

descriptionstring

An optional description of this Generative Service.

promptstring

Actual prompt to be executed during AI generation when executing this service.

modelstring

AI Model to be used in this Generative Service.

temperaturenumber (double)

AI's temperature value for execution of this Generative Service.

maximumTokensinteger (int32)

Maximum tokens to be used during a single execution of this Generative Service.

topPnumber (double)

AI's topP value for execution of this Generative Service.

presencePenaltynumber (double)

AI's presence penalty value for execution of this Generative Service.

frequencyPenaltynumber (double)

AI's frequency penalty value for execution of this Generative Service.

responseVariableNamestring

Name of the variable in $hiddenContext this service will store it's result.

usesBlacklistboolean

Wether this execution should blacklist specific words.

blacklistWordsstring

A blacklist of comma-separated terms to be excluded from this service's generation.

Response

200400401403404409422500

Ok

Body

application/json

text*string

Text generated by prompt

usedTokens*integer (int32)

Consumed tokens for output

Request

JavaScriptCurl

const response = await fetch('/org/{orgUUID}/env/{envUUID}/bot/{botUUID}/generative-service/simulate', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "name": "text"
    }),
});
const data = await response.json();

Response

{
  "text": "text"
}