Project basics

Format

  • Form groups of two
  • Pick a paper that includes an extensive proof out of the list (or double-check your own suggestion with me)
  • Sign ups for a paper/project will be opened on October 4, 13:15

Timeline

Milestones

Proposal

Until 18.3. 23:59, send an email to the supervisor of your project listed here with a pdf containing:

  • Choice of paper, group members
  • Division of labor in the group
  • Identify and motivate the problem of the paper in your own words(as defined in below)

Mid-project drafts

Consider this as an opportunity for you to receive feedback

  • Draft presentation slides in .pdf format, according to instruction below
  • A .pdf with
    • report on what each individual has done
    • plan and division of labor until report deadline

Final content

The project report and presentation should include the following sections:

  1. Identify and motivate problem - why should I / the community care? Including literature review (done-ish)

In presentation (and report):

  1. “Detective hat”: Intuitive (not just technical level) understanding of proof, assumptions, statement in depth

    • Present it in a modular way: a) give intuition, b) proof depends on lemma 1,2,3, which are insightful and intuitive (give rise to potential new proofs) c) proofs of lemmas that are technical
    • If a proof is written in a way that obscures insights, fix that
    • Examine if results follow from other older known results and it’s just a reformulation, facilitated by ignorance (reinventing the wheel)
  2. “Reviewer hat”: Which relevant questions does it shed light on and it actually answer it / solve the problem? How significant is the addition of this paper compared to existing literature

  3. What are interesting, impactful follow-up questions they did not answer and would be interesting to pursue? Show evidence that the question(s) you identified are indeed relevant to understand important phenomena in practice and are novel in the literature. You can start with the paper’s weakness. Examples are

    • They developed theory but assumptions are too removed from practice they aim to prove, i.e. no recognizable link (example could be toy example that shares phenomena). In this case, come up with and run experiments that prove this point. Come up with idea what is needed (theoretically or experimentally) to make the paper impactful
    • You see that the experiments are non-rigorous and not reproducible, they do not support the theory nor heuristic claims.
    • The problem they aim to solve is not exactly relevant. Identify which possible tweaks in their problem formulation could fix that
    • By doing some experiments you find a curious phenomenon that hasn’t been considered and is not explained by the paper
    • Tightening upper bounds by constant or log factors didn’t lead to new insights.

In report:

  1. Break down the problem as much as you can into chunks that you can indeed pursue (or at least, the first few steps), e.g. to prove a conjecture give intuition, lemmas you think you need, and try to prove some of them.

  2. Show your attempts to tackle the first few steps.

Evaluation

Each of the project proposal, progress report, and final project report should be neatly typeset as a PDF document using TeX, LaTeX, or similar systems with bibliographic references (e.g., using BibTeX). Check here for typesetting resources.

The total project grade will depend equally on

  • presentation with rubric
  • structure, clarity and language in report (as in guidelines)
  • content as specified below

Presentation

Basics:

  • Length: 18 minutes total using slides (beamer recommended, e.g. using pandoc markdown) + 5 minutes discussion
  • For groups of two: Each person should present for 9 minutes
  • Watch this video on good slides: https://www.youtube.com/watch?v=meBXuTIPJQk
  • Find more detailed, generally applicable project feedback, addressing common issues here

Content (see this for corresponding details)

  • Short problem introduction, motivation and lit review (20%)
  • Proof presentation (30%)
  • Paper discussion (30%)
  • Follow-up questions + motivation and possible methods of attack (20%)

The later your presentation, the more of the last bullet point is expected to be included.

Grade determined by peer feedback and self-feedback on the presentation

See rubric which will be used for assessment.

Report

Content:

  • The combination of presentation slides and report should contain the content described above. The way to split it will probably be different in each project. If you were able to discuss the proof in the amount of detail you find insightful during the presentation, you can focus more on your own work.

  • Furthermore the pure reproduction (including necessary restructuring and rephrasing) of paper result + proof presentation sections should not constitute more than 50% of the report. Your own investigations should be in the focus here. That may include an extensive literature review, experimental explorations, follow-up theoretical conjectures/results etc. If the proof is poorly presented in the original paper (i.e. convoluting the key ingredients etc.), a simpler proof will also count towards “own investigations”

  • Length: In the Neurips format (see template below) it should be at most 10 pages main text, excluding references and appendix, where you could add more experiments and proof of technical lemmas etc.

Style:

Please see the following guidelines which will be used to guide the presentation portion of the report grade

  • Follow this as a guideline for content
  • Follow this as a guideline for good academic writing in general and this specifically for mathematical writing
  • Follow the latex specific style guide for the report
  • Use this paper template
  • On contributions for individuals: please indicate who contributed what

Content grade

In terms of content, it is not the absolute results that will be graded (i.e. you don’t have to prove a new theorem or write a new conference paper), but the depth at which you investigate the paper’s faults and contributions critically, put it into context and the novelty and impact of the follow-up questions that you would like to pursue. Hence, primarily you will be graded on points 1-4 in Final Content

Obviously it’s great if you succeed to solve your follow-up questions (i.e. successfully manage points 5-6), and that’ll be a big bonus for the grade, but you can achieve a good grade without actually having publishable results. Maybe think of it as a proposal for a master thesis project with preliminary ideas and/or results.

Presentation schedule

Date Presenter Paper title Peer graders
9.12.
13.12.
16.12.
20.12.

Papers

  • Papers suggested this semester

  • most of those are published (even though we often only provide an arxiv link, as it often has the complete most updated version)

  • You can choose your own paper, however you have to double check with the instructor before registering the paper.

  • Please put your name down on the spreadsheet announced on moodle on 4.10. next to the paper you want to work on

  • If there are two papers listed for one number it means that you are expected to read both for context (this actually makes your life easier since you are given what you otherwise need to find yourself) and can choose to focus on one

  • One group per paper, two people per group. First come first serve.