Git Product home page Git Product logo

dplink's Introduction

DPLink

PyTorch implementation for DPLink: User Identity Linkage via Deep Neural Network From Heterogeneous Mobility Data. Jie Feng, Mingyang Zhang, Huandong Wang, Zeyu Yang, Chao Zhang, Yong Li, Depeng Jin. WWW 2019. If you find our code is useful for your research, you can cite our paper by:

@inproceedings{feng2019dplink,
  title={DPLink: User Identity Linkage via Deep Neural Network From Heterogeneous Mobility Data},
  author={Feng, Jie and Zhang, Mingyang and Wang, Huandong and Yang, Zeyu and Zhang, Chao and Li, Yong and Jin, Depeng},
  booktitle={The World Wide Web Conference},
  pages={459--469},
  year={2019},
  organization={ACM}
}

Datasets (updated 2024.06.16)

  • ISP-Weibo Data (main data used in the paper)
    • This is the private data collected and processed by ourselves and partners. We cannot directly published it due to the privacy issue. If you are interested in it and want to use it in your paper for academic purpose, you can contact with us via the email in this page with your identity information. We have uploaded the data in data, please follow the README.md to process the data. This data is intended for academic use only. Redistribution of this data is not permitted without our explicit permission.
  • Foursquare-Twitter Data
    • This data is from Transferring heterogeneous links across location-based social networks. Jiawei Zhang, Xiangnan Kong, and Philip S. Yu. WSDM 2014. We have no right to directly publish it. If you are interested in this dataset, you can contact with the original author to access the dataset.

Requirements

  • Python 2.7
  • PyTorch 0.4
  • tqdm 4.22
  • mlflow 0.5
  • numpy 1.14.0
  • setproctitle 1.1.10
  • scikit-learn 0.19.1

Project Structure

  • run.py # scripts for run experiments
  • match.py # training codes
  • preprocessing.py # trajectory data preprocessing
  • utils.py # utils for training
  • models.py # models
  • GlobalAttention.py # attention scripts from opennmt-py

Usage

To train a new model (default settings are recorded in the run.py)

python run.py --data=foursquare --model=ERPC --pretrain=1 --pretrain_unit=ERCF

E: embedding, R: rnn, P: pooling, C: co-attention, F: fully connected network. ERPC is the default model in paper, model name can also be ERC(without pooling). ERCF is the default pretrain mode in paper, which means all the components in the model are pretrained. You can choose E, R, C, F for only pretrain selected component and N is for non-pretrain.

Acknowledgements

Baselines from traditional baselines, TULER and t2vec. Some codes from OpenNMT-py, InferSent and awd-lstm-lm.

dplink's People

Contributors

vonfeng avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

dplink's Issues

关于数据集问题

您好,按照提供的页面给李老师发了邮件但是还没有收到回复,您能否提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]

请教

请问这个项目没有拿到数据集的话,还能跑得起来吗?

关于数据集的问题

您好,我按照Readme中提到的向Dr. Yong li 发邮件请求数据集,但是可能教授过于繁忙,至今未收到回复,请问您能提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]

内存占用大

HI,我使用您的代码跑了Foursquare-Twitter数据集,但不知道为什么在preprocess的时候会内存占用很大,大概占到了80g。主要是出现在了data_train_match_fix2()这个函数中,请问是什么问题呢?我现在数据集的输入是每条记录当作输入:uid,time,loc。是因为输入的格式问题吗?

谢谢您的解答。

关于数据集问题

您好,按照提供的页面给李老师发了邮件但是还没有收到回复,您能否提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]

关于数据集问题

您好,按照提供的页面给李老师发了邮件但是还没有收到回复,您能否提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]

关于代码的问题

您好,在我使用Foursquare-Twitter数据集执行代码的过程中发生了如下问题:
Traceback (most recent call last):
File "run.py", line 106, in
experiments = service.list_experiments()
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\tracking\service.py", line 68, in list_experiments
return self.store.list_experiments()
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\store\file_store.py", line 82, in list_experiments
return [self.get_experiment(exp_id) for exp_id in list_subdirs(self.root_directory)]
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\store\file_store.py", line 82, in
return [self.get_experiment(exp_id) for exp_id in list_subdirs(self.root_directory)]
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\store\file_store.py", line 118, in get_experiment
return self._get_experiment(experiment_dirs[0])
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\store\file_store.py", line 110, in _get_experiment
meta = read_yaml(experiment_dir_path, FileStore.META_DATA_FILE_NAME)
File "E:\anaconda\Anaconda\lib\site-packages\mlflow\utils\file_utils.py", line 153, in read_yaml
raise Exception("Yaml file '%s' does not exist." % file_path)
Exception: Yaml file '/data1/output.trash\meta.yaml' does not exist.
请问这个该怎么解决?
以及我按照Readme中提到的向Dr. Yong li 发邮件请求数据集,但是可能教授过于繁忙,至今未收到回复,请问您能提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]

关于数据集的问题

您好,我按照Readme中提到的向Dr.Yong Li发送邮件请求数据集,但可能教授最近颇为繁忙,至今没有收到回复,能请您提供一份ISP-Weibo的数据集给我吗?我的邮箱是[email protected]
另外我参照Readme中所写,找到了另一份数据集Foursquare-Twitter Data的出处,但是原文作者附录的邮箱不知道是否是地址问题,我无法联系上原文作者,不知道您这边当时联系的作者邮箱地址能否发送一下。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.