Discord
- Kaylin Linke
- Aaron Strat
- Charles Brazzel
Socialgist has developed a targeted Discord crawling product.
Source Attributes | Description |
|---|---|
Data Delivery Method | initially Discord will be available via stream only |
Approach | crawling is focused on individual servers |
Data Types | channels, messages |
Crawl Frequency | 8 hrs |
Data Availability | Discord uses a system of permissions where you see certain channels or messages based on what level user you are on a given server. The crawled user will typically have low access to a server. |
Historical Data | Up to 7 days of history will be collected on initial crawl. |
Data Dictonary
Field Name | Field Description | Data Example |
|---|---|---|
message.id | Unique identifier for the message. | 1029588052181520484 |
message.url | Direct URL to the specific message within a Discord channel. | Discord - A New Way to Chat with Friends & Communities |
message.type | Type of the message. | 0 |
message.text | Text content of the message. | <@784624567175086122> is dropping 2 cards! |
message.pinnedMessage | Boolean indicating if the message is pinned. | FALSE |
message.textToSpeach | Boolean indicating if the message has text-to-speech enabled. | FALSE |
message.mentionEveryone | Boolean indicating if the message mentions everyone. | FALSE |
message.timestamp | Timestamp of when the message was sent. | 2022-10-12T02:55:20.000Z |
message.editTimestamp | Timestamp of when the message was last edited, if applicable. | null |
message.mentionedUsers[].taggedId | ID of the user mentioned in the message. | 784624567175086122 |
message.mentionedUsers[].taggedName | Name of the user mentioned in the message. | miaomi |
message.reactions | Array of reactions to the message. | [] (Empty in provided example) |
message.attachments[].attachId | ID of the attachment. | 1029588051996971088 |
message.attachments[].attachUrl | URL of the attachment. | https://cdn.discordapp.com/attachments/748538859041587231/1029588051996971088/cards.png |
message.attachments[].attachSize | Size of the attachment in bytes. | 146018 |
message.attachments[].attachContent | Type of the attachment content. | image/png |
message.attachments[].attachWidth | Width of the attachment if it's an image. | 600 |
message.attachments[].attachHeight | Height of the attachment if it's an image. | 320 |
message.embeds | Array of embedded content in the message. | [] |
message.referencedMessage.id | ID of the referenced message, if any. | null |
message.referencedMessage.text | Text of the referenced message. | null |
message.referencedMessage.authorID | ID of the author of the referenced message, if any. | null |
message.referencedMessage.authorName | Name of the author of the referenced message, if any. | null |
message.referencedMessage.timestamp | Timestamp of when the referenced message was sent , if any. | null |
author.id | Unique identifier for the author of the message. | 815289915557675118 |
author.name | Name of the message author. | Gachapon |
author.avatar | URL to the avatar of the message author. | https://cdn.discordapp.com/avatars/815289915557675118/506faafbddc9ea4860bcf5f1d2c97700.webp |
channel.id | Unique identifier for the channel the message was sent in. | 748538859041587231 |
channel.url | Direct URL to the specific channel. | https://discord.com/channels/740603599775596685/748538859041587231 |
channel.name | Name of the channel. | 🎲》general |
server.id | Unique identifier for the server (guild) the message was sent in. | 740603599775596685 |
server.name | Name of the server (guild). | President Anime Memes |
crawled | Timestamp of when the data was crawled. | 2022-10-13T21:57:00.802Z |
origin | Origin URL from which the data was extracted. | |
clientId | ID of the client application. | 0 |
product | Name of the product related to the data. | discord_dev |
type | Type of the data. | message |
Data Payloads
Messages
{
"message": {
"id": "1029588052181520484",
"url": "https://discord.com/channels/740603599775596685/748538859041587231/1029588052181520484",
"type": 0,
"text": "<@784624567175086122> is dropping 2 cards!",
"pinnedMessage": false,
"textToSpeach": false,
"mentionEveryone": false,
"timestamp": "2022-10-12T02:55:20.000Z",
"editTimestamp": null,
"mentionedUsers": [
{
"taggedId": "784624567175086122",
"taggedName": "miaomi"
}
],
"reactions": [],
"attachments": [
{
"attachId": "1029588051996971088",
"attachUrl": "https://cdn.discordapp.com/attachments/748538859041587231/1029588051996971088/cards.png",
"attachSize": 146018,
"attachContent": "image/png",
"attachWidth": 600,
"attachHeight": 320
}
],
"embeds": [],
"referencedMessage": {
"id": null,
"text": null,
"authorId": null,
"authorName": null,
"timestamp": null
}
},
"author": {
"id": "815289915557675118",
"name": "Gachapon",
"avatar": "https://cdn.discordapp.com/avatars/815289915557675118/506faafbddc9ea4860bcf5f1d2c97700.webp"
},
"channel": {
"id": "748538859041587231",
"url": "https://discord.com/channels/740603599775596685/748538859041587231",
"name": "🎲》general"
},
"server": {
"id": "740603599775596685",
"name": "President Anime Memes"
},
"crawled": "2022-10-13T21:57:00.802Z",
"origin": "https://discord.com/invite/c9AFdNB",
"clientId": "0",
"product": "discord_dev",
"type": "message"
}
Channels
{
"channel": {
"id": "874599770927284254",
"url": "https://discord.com/channels/568567800910839811/874599770927284254",
"name": "status-feeds",
"type": null,
"topic": "https://discord.gg/Nnttd7EZV4",
"nsfw": false,
"access": false
},
"server": {
"id": "568567800910839811",
"name": "Delly",
"desc": "The official server of Discord Extreme List: Discord's unbiased list, giving bots and servers of all sizes a big chance!"
},
"crawled": "2022-10-18T15:57:26.444Z",
"origin": "https://discord.com/invite/WeCer3J",
"clientId": 0,
"product": "discord_dev",
"type": "channel"
}