I am working at a company which sends surveys to companies using TypeForm, we now want to fetch the data from TypeForm using Webhooks, this is not an issue, here is an example of the payload I get from a webhook once an answer is sumbitted:
{
"event_id": "LtWXD3crgy",
"event_type": "form_response",
"form_response": {
"form_id": "lT4Z3j",
"token": "a3a12ec67a1365927098a606107fac15",
"submitted_at": "2018-01-18T18:17:02Z",
"landed_at": "2018-01-18T18:07:02Z",
"calculated": {
"score": 9
},
"definition": {
"id": "lT4Z3j",
"title": "Webhooks example",
"fields": (
{
"id": "DlXFaesGBpoF",
"title": "Thanks, {{answer_60906475}}! What's it like where you live? Tell us in a few sentences.",
"type": "long_text",
"ref": "(readable_ref_long_text",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "SMEUb7VJz92Q",
"title": "If you're OK with our city management following up if they have further questions, please give us your email address.",
"type": "email",
"ref": "readable_ref_email",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "JwWggjAKtOkA",
"title": "What is your first name?",
"type": "short_text",
"ref": "readable_ref_short_text",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "KoJxDM3c6x8h",
"title": "When did you move to the place where you live?",
"type": "date",
"ref": "readable_ref_date",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "PNe8ZKBK8C2Q",
"title": "Which pictures do you like? You can choose as many as you like.",
"type": "picture_choice",
"ref": "readable_ref_picture_choice",
"allow_multiple_selections": true,
"allow_other_choice": false
},
{
"id": "Q7M2XAwY04dW",
"title": "On a scale of 1 to 5, what rating would you give the weather in Sydney? 1 is poor weather, 5 is excellent weather",
"type": "number",
"ref": "readable_ref_number1",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "gFFf3xAkJKsr",
"title": "By submitting this form, you understand and accept that we will share your answers with city management. Your answers will be anonymous will not be shared.",
"type": "legal",
"ref": "readable_ref_legal",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "k6TP9oLGgHjl",
"title": "Which of these cities is your favorite?",
"type": "multiple_choice",
"ref": "readable_ref_multiple_choice",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "RUqkXSeXBXSd",
"title": "Do you have a favorite city we haven't listed?",
"type": "yes_no",
"ref": "readable_ref_yes_no",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "NRsxU591jIW9",
"title": "How important is the weather to your opinion about a city? 1 is not important, 5 is very important.",
"type": "opinion_scale",
"ref": "readable_ref_opinion_scale",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "WOTdC00F8A3h",
"title": "How would you rate the weather where you currently live? 1 is poor weather, 5 is excellent weather.",
"type": "rating",
"ref": "readable_ref_rating",
"allow_multiple_selections": false,
"allow_other_choice": false
},
{
"id": "pn48RmPazVdM",
"title": "On a scale of 1 to 5, what rating would you give the general quality of life in Sydney? 1 is poor, 5 is excellent",
"type": "number",
"ref": "readable_ref_number2",
"allow_multiple_selections": false,
"allow_other_choice": false
}
)
},
"answers": (
{
"type": "text",
"text": "It's cold right now! I live in an older medium-sized city with a university. Geographically, the area is hilly.",
"field": {
"id": "DlXFaesGBpoF",
"type": "long_text"
}
},
{
"type": "email",
"email": "laura@example.com",
"field": {
"id": "SMEUb7VJz92Q",
"type": "email"
}
},
{
"type": "text",
"text": "Laura",
"field": {
"id": "JwWggjAKtOkA",
"type": "short_text"
}
},
{
"type": "date",
"date": "2005-10-15",
"field": {
"id": "KoJxDM3c6x8h",
"type": "date"
}
},
{
"type": "choices",
"choices": {
"labels": (
"London",
"Sydney"
)
},
"field": {
"id": "PNe8ZKBK8C2Q",
"type": "picture_choice"
}
},
{
"type": "number",
"number": 5,
"field": {
"id": "Q7M2XAwY04dW",
"type": "number"
}
},
{
"type": "boolean",
"boolean": true,
"field": {
"id": "gFFf3xAkJKsr",
"type": "legal"
}
},
{
"type": "choice",
"choice": {
"label": "London"
},
"field": {
"id": "k6TP9oLGgHjl",
"type": "multiple_choice"
}
},
{
"type": "boolean",
"boolean": false,
"field": {
"id": "RUqkXSeXBXSd",
"type": "yes_no"
}
},
{
"type": "number",
"number": 2,
"field": {
"id": "NRsxU591jIW9",
"type": "opinion_scale"
}
},
{
"type": "number",
"number": 3,
"field": {
"id": "WOTdC00F8A3h",
"type": "rating"
}
},
{
"type": "number",
"number": 4,
"field": {
"id": "pn48RmPazVdM",
"type": "number"
}
}
)
}
}
Our applications are currently using a MongoDB base (I am more of a Postgre guy, but I am willing to learn NoSql)
I was thinking about the design of the structure which should hold the results of the survey, but I was looking for some advice/feedback.
Here are the constraints:
-
Each time a company wants to take a survey, we create a new survey for the company in TypeForm, which means that technically Typeform_id <=> A company answer to a survey.
-
The surveys are not always the same, they can change, or have additional questions
-
The survey measure numeral “traits”, that are defined by several questions
-
However for some of these questions, I need to be able to aggregate all the answers given from all the companies to generate a benchmark.
-
A company can take plural surveys at the same time, or take the same survey after some time passes
-
For now we are talking about thousands of answers, but these numbers could grow quickly
I am coding in (java, spring), so i saw that i could use a DBObject and parse the json into it, but I keep thinking that I need to somehow sort the data before :
Using the field ref i was planning to provide data that I could parse to compute a score for the answer provided to each question.For example :
- From the
ref of the survey, i could get the company name, the survey name, the language, and the number of times the survey’s been taken
- From the
ref of a question, i could get the name of the trait being measured, the maximal value, and the name of the question (so that I can compare its results to the result from other surveys)
For my dashboard I need to show: the questions, the answer given to each of them, be able to segmentate based on some answers, show the score on each “trait”, a global score (age, size…etc)
I am aware of the maximum size of a document, so I was wondering, if i should create a document for each survey with its answers ? or create a collection containing all the answers and keep the surveys appart ?
Or am I going the wrong way ?
Thanks for your time !
