TikTok
- Kaylin Linke
- Charles Brazzel
- arodriguez
Socialgist has developed a targeted TikTok crawling product.
Source Attributes | Description |
|---|---|
Data Delivery Method | filtered stream |
Approach | crawling is focused on user and hashtag pages |
Data Types | videos, hashtag stats, top level comments |
Crawl Frequency |
|
Data Availability |
|
To participate in program, submit user pages and hashtag pages your clients wish to track and analyze.
Data Dictionary
Video Payload
Field Name | Field Description | Data Example |
|---|---|---|
audio.author | Name of the artist or band that plays the sound or song that overlays the video. | “Coldplay” |
audio.duration | Duration of the song or sound that overlays the video in seconds. | 60 |
audio.id | Unique identifier assigned by TikTok for the audio overlay. | 6817757662952818689 |
audio.rawAudioUrl | The download link for the audio file which overlays the video. | https://sf16-ies-music-sg.tiktokcdn.com/obj/tos-alisg-ve-2774/8778f5f2662c4af0b5c7617741f129c9 |
audio.title | Title of the song or sound used in the video. | Summer Background Jazz |
author.avatar | If available, a URL link to the author’s avatar. | |
author.followers | Where available, the number of followers the author has. | 220000 |
author.following | Where available, he number of accounts the author is following. | 324 |
author.hearts | The number of likes the author has received from all the videos posted in his/her account. | 63800000 |
author.id | Unique identifier assigned by TikTok for the TikTok author. | 6671887997636165638 |
author.likedVideos | Where available, number of videos the author has liked on TikTok. | 1865 |
author.name | Name of the author as it appears on TikTok. | courtandnate |
author.nickname | If different, the nickname chosen by the author. If no nickname is being used, this field will populate the author name. | courtandnate |
author.url | A URL linking to the author’s profile. | |
author.videos | Where available, total number of videos published in the author’s profile. | 340 |
clientId | Unique ID Socialgist assigns internally to represent the client who requested the page which produced that piece of data. | 14 |
crawled | The date/time a video was harvested from TikTok. | 2022-05-14T20:26:23.946Z |
discoverySource | Indicates when the crawled page was discovered via a tag on another page | TBD |
origin | A link to the profile that originally published the video. | |
product | The type of product being used. | tiktok_dev |
type | The type of content that is being crawled. | video |
update | Boolean field (either true or false) which represents where the video message is an update on a previously sent video(update:true), or if it is the first time sending data on that video (update:false). | TRUE |
video.comments | Number of comments available on the video. | 235 |
video.description | The description offered for the video. | the best part of my day🍵🌊 #morningroutine #matchalatte #matcha #vanlife |
video.duration | The total duration of the video in seconds. | 15 |
video.format | The format the video is using. It can be either .MP4 or .MOV. | mp4 |
video.hashTags.tagId | Unique identifier assigned by TikTok to the tag. | 15747, 32320846, 5079120, 23373684 |
video.hashTags.tagName | The name of the hashtag being used in the video. | morningroutine, matchalatte, matcha, vanlife |
video.hearts | Where available, The number of hearts or likes the video has received. | 12,600 |
video.id | Unique identifier assigned by TikTok to the video. | 7093555676173176106 |
video.height | Total height of the video in pixels. | 1024 |
video.isAd | Where available, boolean field (either true or false) which represents if the video is an ad (TRUE) or not (FALSE). | TRUE |
video.plays | Total number of times the video has been played on TikTok. | 92300 |
video.publishDate | The date the video was published in TikTok. | 2022-05-03T16:58:56.000Z |
video.quality | Video resolution in pixels of the video being crawled. | 720p |
video.rawVideoUrl | Download link for the video without the audio overlay. | |
video.shares | The total number of times the video has been shared. | 22 |
video.stickers.stickerText | If available, the text of the stickers included in the video. | make matcha, with me |
video.thumbnailUrl | A link to the video’s thumbnail. | |
video.url | A link to the video being crawled. | https://www.tiktok.com/@courtandnate/video/7093555676173176106 |
video.width | The total width of the video being crawled. | 576 |
video.labels | Where available, labels attached to video. |
|
author.signature | Brief user summary found on the users page |
|
author.verified | Boolean field (either true or false) which represents if the author is verified (TRUE) or not (FALSE). | TRUE |
music.original | Boolean field (either true or false) which represents if the audio on the video is original (TRUE) or not (FALSE). | TRUE |
shareEnabled | Boolean field (either true or false) which represents if the author has enabled sharing of the video(TRUE) or not (FALSE). | FALSE |
video.bitrate | Additional video file info |
|
video.encodedType | Additional video file info |
|
video.videoQuality | Additional video file info |
|
video.volumeInfo.Loudness | Additional video file info |
|
author.CommentSetting | Author setting | 0 |
author.downloadSetting | Author setting | 0 |
author.duetSetting | Author setting | 0 |
author.ftc | Author setting | false |
author.isADVirtual | Author setting | false |
author.isEmbedBanned | Author setting | false |
author.openFavorite | Author setting | false |
author.privateAccount | Author setting | false |
author.relation | Author setting | 0 |
author.secret | Author setting | false |
author.stitchSetting | Author setting | 0 |
collected |
| false |
digged | Engagement | false |
duetDisplay |
| 0 |
duetEnabled | Boolean field | true |
forFriend | Boolean field | false |
itemCommentStatus |
| 0 |
officialItem | Boolean field | false |
originalItem | Boolean field | false |
privateItem | Boolean field | false |
secret | Boolean field | false |
stitchDisplay |
| 0 |
stitchEnabled | Boolean field | true |
video.encodeUserTag |
|
|
Video Payload - add-on transcription option
Field Name | Field Description | Data Example |
|---|---|---|
transcribed | Boolean field (either true or false) which represents if the video has been transcribed (TRUE) or not (FALSE). | TRUE |
hasDialog | Boolean field (either true or false) which represents if the video includes dialog that can be transcribed(TRUE) or not (FALSE). | TRUE |
gallery | Boolean field (either true or false) which represents if the video is a gallery of images and therefore cannot be transcribed (TRUE) or not (FALSE). | FALSE |
language code | Code representing the language of the video. | "fr-FR" |
transcript | Actual transcript of the video | "et puis pour empêcher” |
Tag Payload
Field Name | Field Description | Data Example |
|---|---|---|
clientId | Unique ID Socialgist assigns internally to represent the client who requested the page which produced that piece of data. | 13 |
crawled | The date/time a video was harvested from TikTok. | 2022-05-14T22:38:02.323Z |
discoverySource | Indicates when the crawled page was discovered via a tag on another page | TBD |
firstObserved | Represents the first date that Socialgist began tracking stats for this hashtag. Note that it does not represent when the hashtag first appeared on Tiktok, as this data is not currently available via crawling. | 2022-015-0T00:00:00.000Z |
hashtag | The name of the hashtag being crawled. | #followforfollowback |
product | The type of product being used to crawl TikTok. | tiktok_dev |
stats.videoCount | Total videos using the hashtag being crawled. | 2400000 |
stats.viewCount | Total video views of the videos that include the hashtag being crawled. | 4600000000 |
type | The type of data being crawled. | tag |
url | A URL link to the page showing videos that are currently using the crawled hashtag. |
Comment Payload
Field Name | Field Description | Data Example |
|---|---|---|
author.id | Unique identifier assigned by TikTok for the audio overlay. | 6757439261778240000 |
author.isVideoAuthor | Boolean field (either true or false) which represents if the author of the comment is the author of the video. | FALSE |
author.name | The name of the author of the comment. | triomcswag |
author.nickname | If different, the nickname chosen by the author. If no nickname is being used, this field will populate the author name. | Drey @chaudrons |
clientId | Unique ID Socialgist assigns internally to represent the client who requested the page which produced that piece of data. | 13 |
comment.date | The date the comment was published. | 2022-03-07T15:11:36.000Z |
commen.id | Unique identifier assigned by TikTok to the comment. | 4572893201 |
comment.likes | Number of likes the comment has received. | 39544 |
comment.parentVideo | Unique identifier associated with the video in which the comment was published. | 7072209501465610000 |
comment.replyCount | Number of replies for a comment. | 36 |
comment.text | The full text of the comment. | "smells like mama but looks like enemy...😰" |
crawled | The date/time a video was crawled from TikTok. | 2022-03-09T17:18:55.951Z |
discoverySource | Indicates when the crawled page was discovered via a tag on another page | TBD |
product | The type of product being used to crawl TikTok. | tiktok_dev |
type | The type of data being crawled. | comment |
url | A URL link to the video where the comment was published. | https://www.tiktok.com/@peachesnjojo/video/7072209501465611566 |