Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

无法复现到论文结果 #40

Open
PamelaDDD opened this issue Sep 20, 2020 · 4 comments
Open

无法复现到论文结果 #40

PamelaDDD opened this issue Sep 20, 2020 · 4 comments

Comments

@PamelaDDD
Copy link

根据readme步骤,换了亚马逊电子的数据集运行代码,源代码是3个epoch的,最终best_auc 只能达到0.76左右,和论文0.9相差得有点远,想请问一下有人能跑到论文实验给到的auc吗?

@DrMeiGuang
Copy link

我也是,而且感觉数据负样本的处理也有问题。文章两次生成负样本:

  1. process_data.py文件
    image
  2. data_iterator.py
    image
    1处生成的负样本到2这里成了正样本,我也看不懂。
  3. 负样本可能与历史正样本重复,而且采样方法值得商榷。

@Waydrow
Copy link

Waydrow commented Feb 25, 2021

根据readme步骤,换了亚马逊电子的数据集运行代码,源代码是3个epoch的,最终best_auc 只能达到0.76左右,和论文0.9相差得有点远,想请问一下有人能跑到论文实验给到的auc吗?

电子的数据集DIEN我只能跑到0.74左右,还没有DIN好....有点迷惑。
请问你有测试过DIN和BaseModel吗

@GuoshenLi
Copy link

论文有0.9的结果???

@HerbertArthur
Copy link

DIN的Amazon books测试集AUC我也是只能到0.76左右,请问后来解决了吗?论文里AUC是0.8974,差很多 。@PamelaDDD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants