Constarium
← Search

Data · dataset · 2022

Douban Dataset with Multiple Downstream Tasks for Network Embedding

Listed in ScienceDB

Description

Our new network dataset is crawled from Douban Movies{movie.douban.com}, which is a website providing users comments on movies. Each node in the network represents a movie, and each edge represents that the movies on both ends of it are co-preferenced by audiences, which is provided by Douban. The network contains 31,761 nodes and 179,924 edges.

We use the movie profiles to form the attributes of the node. Firstly, we use ``jieba''{github.com/fxsjy/jieba}, a widely used Chinese word segmentation tool, to segment movie profiles and filter common stop words and words that appear less than three times in the corpus. Then, we build a TF-IDF vector for each movie using scikit-learn and reduce the dimension to 500 via SVD. We build three downstream tasks for this Douban dataset, including movie genres prediction, rating score level prediction, and popularity level prediction.

Read the rest (2 more)

Genre predicting task is a multi-classification task, we directly use the genres of the movie provided by Douban as the label and each movie has at least one genre.  To build the label of the rating score prediction, we rank movies by rating scores and divide them into 10 classes of the same size. Similarly, we rank all the movies according to the number of comments and divide them into three classes of the same size.

For each task, we randomly sample 70\% nodes as the train set, 10\% as the validation set, and the rest as the test set. 

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 10 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.032528 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title