Find Jobs
Hire Freelancers

Modifying files of BigCode Evaluation Harness

₹600-2000 INR

已关闭
已发布10 个月前

₹600-2000 INR

货到付款
Currently, while generate and evaluate on a task using bigcode evaluation harness, it generates a .json file something attached below. The task is to try appending a single hard-coded prompt to prompts in TokenizedDataset in lm_eval/utils.py. First, understand what the exact structure of the resulting prompt will be like. E.g. “Prompt: print hello world \n\n Answer: print(‘hello world’) \n\n Prompt: read a file \n\n Answer: “; vs “Intent: print hello world \n\n Code: print(‘hello world’) \n\n Intent: read a file \n\n Code: “. a. “# prints hello world”; what separator to use between the prompt and the answer b. check the docs on huggingface for models - to see if they have examples of ICL (in-context learning) c. check the papers of the models (codegen) - for any examples how to use ICL with the model
项目 ID: 36717006

关于此项目

2提案
远程项目
活跃9 个月前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
2威客以平均价₹1,300 INR来参与此工作竞价
用户头像
Objective Highly energetic, motivated and enthusiastic teenager able to quickly learn and handle varied responsibilities is seeking employment opportunities to further enhance learning abilities and to gain experience in the workplace. Motivated to work hard to satisfy the employer's needs and goals, will follow directions and adhere to rules and guidelines. Handles tasks with accuracy and efficiency, with a drive for excellence. Reliable, responsible and passionate about working with kids. Positive and friendly attitude and willingness to learn.
₹1,300 INR 在7天之内
0.0 (0条评论)
0.0
0.0

关于客户

INDIA的国旗
Bhopal, India
5.0
6
付款方式已验证
会员自9月 17, 2022起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。