GSoC/2014/Project ideas

From SMC Wiki

Apart from the following ideas , you can propose your own ideas

Potential Mentors

  1. Santhosh Thottingal (santhosh on irc.freenode.net)
  2. Baiju M (baijum on irc.freenode.net)
  3. Praveen A (j4v4m4n on irc.freenode.net)
  4. Rajeesh K Nambiar (rajeeshknambiar on irc.freenode.net)
  5. Vasudev Kammath (copyninja on irc.freenode.net)
  6. Jishnu Mohan (jishnu7 on irc.freenode.net)
  7. Hrishikesh K.B (stultus on irc.freenode.net)
  8. Anivar Aravind (anivar on irc.freenode.net)
  9. Anilkumar K V (anilkumar on irc.freenode.net)
  10. Sajjad Anwar (geohacker on irc.freenode.net)
  11. Deepa V Gopinath (deepagopinath on irc.freenode.net)
  12. jain Basil (jainbasil on irc.freenode.net)
  13. Ershad K (ershad on irc.freenode.net
  14. Navaneeth (nkn__ on irc.freenode.net)
  15. Nishan Naseer (nishan on irc.freenode.net)
  16. Nandaja Varma (gem on irc.freenode.net)

Ideas for Google Summer of Code 2014

Projects with confirmed mentors

A spell checker for Indic language that understands inflections

Project:

SILPA project has a spellchecker written using python with a not so simple algorithm. But still it is not capable of handling inflection and agglutination occurring in Indian languages especially south Indian languages. The dictionary we have for Malayalam spellchecker have about 150000 words. Of course we can expand the dictionary, but that doesn't have much value since words can be formed in Malayalam or Tamil etc by joining multiple words. In addition to that, words get inflected based on grammar forms(sandhi), plural, gender etc. Hunspell has a system to handle this, but so far nobody succeeded in getting it working for multi level suffix stripping as required for Malayalam. Some times a Malayalam word can be formed by more than 5 words joining together. We will need a word splitting logic or a table taking care of all patterns. The project is to attempt solving this with hunspell. If that is not feasible(hunspell upstream is not active), develop an algorithm and implement it.

Recently Tamil attempted developing a spellchecker using Hunspell with multi level suffix stripping. You can see the result here https://github.com/thamizha/solthiruthi. Our attempt should be first to use Hunspell to achieve spellchecking with agglutination and inflection. Probably it will require lot of scripting to generate suffix patterns, we can ask help from existing language communities too. If Hunspell has limitation with multi level suffxes- sometimes Indian languages require more than 5 levels of suffix stripping, we need to document it(bug and documentation) and try to attempt python based solution on top of SILPA framework.

Homework to do before submitting applications:

  1. Use hunspell in any Indian language like Malayalam for spell correction in editors or wordprossors and understand the limirations
  2. Study the nature of inflection and agglutination in Indian languages, read existing documents on this(ask for documents too) and note down your observations
  3. Study hunspell and other spellcheckers to see how this problem is addressed
  4. Understand how a spell checker works. How to write a spellchecker from scratch?
  5. Come up with a plan about addressing the issue.

Complexity: Advanced

Confirmed Mentor: Santhosh Thottingal

How to contact the mentor: IRC - santhosh on #smc-project on Freenode

Expertise required: Average level understanding of grammar system of at least one Indian language and complete the homework as listed above.

What the student will learn:

Indic rendering support in ConTeXt

Project:

ConTeXt is another TeX macro system similar to LaTeX but much more suitable for design. To find more information about ConTeXt, see the wiki http://wiki.contextgarden.net/Main_Page. ConTeXt MKII have Indic language rendering support using XeTeX. but MKII is deprecated, and the new MKIV backend doesn't support Indic rendering yet. The aim of this project is to add support to Inidic rendering to ConTeXt MKIV. XeTeX is using Harfbuzz to do correct Indic rendering.

More Details: A partially working patch by Rajeesh for MKIV lua code is available. ConTeXt mkii (deprecated) can work with XeTeX backend for Indic rendering. Here is a sample file: 

\usemodule[simplefonts]
\definefontfeature[malayalam][script=mlym]
\setmainfont[Rachana][features=malayalam]
\starttext
മലയാളം \TeX ഉപയോഗിച്ച് ടൈപ്പ്സെറ്റ് ചെയ്തത്
\stoptext

Generate the output using command 

texexec --xetex <file.tex>

Complexity : Advanced

Confirmed Mentor : Rajeesh K Nambiar

How to contact the mentor: IRC - rajeeshknambiar on #smc-project on Freenode

Expertise required: Understanding of the TeX system, experience in either LaTeX or ConTeXt and basic understanding of Indic language rendering. MKIV uses Lua, familiarity with Lua, opentype specifications or Harfbuzz will be added advantage.

What the students will learn:


Language model and Acoustic model for Malayalam language for speech recognition system in CMU Sphinx

Project:

CMU Sphinx is a large vocabulary, speaker independent speech recognition codebase and suite of tools, which can be used to develop speech recognition system in any language. To develop an automatic speech recognition system in a language, acoustic model and language model has to framed for that particular language. Acoustic models characterize how sound changes over time. It captures the characteristics of basic recognition units. The language model describes the likelihood, probability, or penalty taken when a sequence or collection of words is seen. It attempts to convey behavior of the language and tries to predict the occurrence of specific word sequences possible in the language. Once these two models are developed, it will be useful to every one doing research in speech processing. For Indian languages Hindi, Tamil, Telugu and Marati, ASR systems have been developed using sphinx engine. In this project work is aimed at developing acoustic model and language model for Malayalam.

Background Reading

Complexity :

Confirmed Mentor : Deepa P Gopinath

How to contact the mentor: IRC - deepagopinath on #smc-project on Freenode

Expertise required:

What the students will learn:


Silpa based

Provide REST API for new flask based Silpa, including conversion of templates to this REST API from JSON RPC

Project:

Silpa is now relying on JSONRPC. We need to, either completely move to REST API or provide REST API as an additional feature.

Objectives:

  • Use Flask-Restuful and write separate module without modifying existing JSONRPC. JSONRPC need to be present to allow backward compatibility
  • Both GET and POST should be supported. Deverloper can decide on what to use. (Do we need this?)

Many people have doubt on how the API should look like. We can give twitter API (https://dev.twitter.com/docs/api) as example Sample API calls : 

   POST api.silpa.org.in/payyans/ASCII2Unicode
   Paramets: text, font
   Response: JSON data

   POST api.silpa.org.in/payyans/Unicode2ASCII
   Paramets: text, font
   Response: JSON data

Generic: 

   GET/POST (http://api.silpa.org.in/module/function_name or http://silpa.org.in/api/module/function_name)
   Parameters: function parameters
   Response: JSON encoded return value from function

Complexity : Easy

Confirmed Mentors : Vasudev Kamath, Jishnu Mohan

How to contact the mentors: IRC -

  • Vasudev Kamath - copyninja on #smc-project and #silpa on Freenode
  • Jishnu Mohan - jishnu7 on #smc-project and #silpa on Freenode

Expertise required: Python , Flask , Jinja , HTML, Javascript

What the students will learn:

Android SDK for Silpa

Project:

Port possible Silpa modules to java and create SDK so that other developers can use this for their apps. Modules like Indic Render, Transliteration, Payyas has really good potential in android because of the fragmentation exists in Android and lack for proper Indic support. This SDK will help developers to support their Indic app in wide range of android devices.

Objectives: <Please note this idea is for a SDK, not an app or just a java port>

  • All modules need to be ported to java so that it can be used inside an Android Project.
  • Other applications should be able to use this Silpa library to easy integrate features (as a SDK) from our modules. Eg.
    • Transliteration - Developer can specify a text input inside the application needs transliteration, and our SDK should take care of the transliteration process whenever user inputs text to that field.
    • Render module - Detect whether necessary font is available in the system, if it is not, render text as image and replace text with this.
    • All modules can be explained like this.
  • Investigate whether image rendering part of render module can be done in device, inside application itself. Few ways to implement that are
    • Compiling cairo/pango with ndk
    • Compiling Harffbuzz from AOSP tree with ndk
    • Based on the result of rendering module investigation, we can device on whether to use server side rendering or not.
    • Pack popular fonts with the SDK, Use it to display text if device doesn't have required font. (there are few hacks to get better rendering in older versions of android). Developer should be able to force rendering using packaged font, to get consistency across devices.

<Better to prepare SDK with helper than preparing application itself. SDK aka library>

Complexity : Advanced

Confirmed Mentors : Hrishikesh K. B, Jishnu Mohan, Aashik S

How to contact the mentor: IRC -

  • Hrishikesh K B - stultus on on #smc-project and #silpa on Freenode
  • Jishnu Mohan - jishnu7 on #smc-project and #silpa on Freenode
  • Aashik S - irumbumoideen on #smc-project on Freenode

Expertise required: Java, Android, Python

What the students will learn:

Converting indic processing modules currently in SILPA into javascript modules library

Project:

Port some of the silpa algorithms to node modules. Several modules, alogorithms in SILPA project is done in python now. But porting them to javascript helps developers. For example, cross language transliteration can be done javascript too if we port the algorithm and transliteration rules. Similarly the approximate search can be ported. A flexibile fuzzy search on the web pages will be possible if we have the algorithm in javascript.

Proposed javascript module pattern is https://github.com/umdjs/umd

Student proposals should have a list of alogorithms planning to port, planned demo applications, planned documentation details, and publishing details(Example: npm registry)

Complexity :

Confirmed Mentor : Jishnu Mohan

How to contact the mentor: IRC - jishnu7 on #smc-project and #silpa on Freenode

Expertise required: javascript, python

What the students will learn:


Improving cross language transliteration system.

Project:

Currently only Kannada and Malayalam are perfect rest all are first converted to Malayalam then to English due to lack of language internal. Also currently for English to Indic we use CMUDict so transliteration capability is limited to words in CMUDict only probably we could develop better method for English to Indic transliteration. Current Indic to English and vice versa transliteration depends on CMUSphinx dictionary which is having limited set of words which will result in some words being left in native text.

CLDR has transliteration data for Indic languages. We can explore it and see the feasibility. For an intermediate representation of the scripts either IPA can be used or ISO 15919 standard can be used. All these must be supplemented with exception rules and special case handling to achieve more perfect result.

Complexity : Easy

Confirmed Mentors : Vasudev Kamath, Jishnu Mohan

How to contact the mentor: IRC -

  • Vasudev Kamath - copyninja on #smc-project and #silpa on Freenode
  • Jishnu Mohan - jishnu7 on #smc-project and #silpa on Freenode

Expertise required: Python

What the students will learn:

Internationalize SILPA project with Wikimedia jquery projects , Improve the webfonts module in Silpa using jquery.webfonts and provide more Indic and complex fonts as part of it

Project:

Internationalize SILPA :- SILPA project has many Indic language applications, but as of now, if somebody want to input in Indian languages, there is no built in tool in it. Similarly, the application is not internationalized. Both of these can be achieved by using the jquery.ime and jquery.i18n libraries from Wikimedia. A sample implementation is avaliable in our website. The i18n should be in the SILPA flask framework with a nice templating system. Similarly the interface should have webfonts using jquery.webfonts library.

Improve the webfonts  :-

  • Currently Silpa provides 36 webfonts. add more fonts to this collection.
  • Rewrote webfonts module to use the features of jquery.webfonts
  • Create a repo as per jquery.webfonts specification
  • Provide a clean api so that other websites can use our webfonts in their websites
  • Document the usage
  • Provide font preview and download options
  • **This is partly done**(Task from last GSoC)
  • flask-webfonts needs further improvements and fine tuning
  • This should be integrated into our SILPA and submitted to Flask


More Details

Complexity : Medium

Confirmed Mentors : Vasudev Kamath, Jishnu Mohan

How to contact the mentor: IRC

  • Vasudev Kamath - copyninja on #smc-project and #silpa on Freenode
  • Jishnu Mohan - jishnu7 on #smc-project and #silpa on Freenode

Expertise required: jQuery, css, html5, Python , flask , technical understanding about fonts

What the students will learn:

Language filter for diaspora

Diaspora is a Free Software, federated social networking platform. Diaspora users post in many languages. When people use more than one language in their posts, it is inconvenient for people who don't understand a language. This task is to tag every post with languages used in the post, ideally detected automatically, but with an option to override it. Once each post has a language tag, people should be able to choose their preferred language and posts in other languages should be hidden by default. Also provide an option to translate posts and comments.

Complexity :

Confirmed Mentors : Pirate Praveen, Ershad K

How to contact the mentors: IRC

  • Pirate Praveen - j4v4m4n on #smc-project on Freenode
  • Ershad K - ershad on #smc-project on Freenode

Expertise required: Ruby on Rails

What the students will learn:


Varnam Based

Varnam is a cross-platform predictive transliterator for Indian languages. It works mostly like Google's transliterate, but shows key differences in the way word tokenization is done. It has a learning system built in which allows Varnam to make smart predictions.

There are varnam clients available as Firefox] & Chrome addon and an IBus engine.

To try out Varnam, navigate to [http://varnamproject.com/editor]. Currently it support Hindi and Malayalam.

  • FAQ - [1]
  • Documentation - [2]
  • Contributors guide - [3]


Improvements to the REST API

Project:

This includes rewrite of the current implementation in `golang` and add support for WebSockets to improve the input experience. This also includes making scripts that would ease embedding input on any webpage. All the changes done will go live on[1]

Complexity : Advanced

Confirmed Mentor : Navaneeth K N

How to contact the mentor: IRC - nkn__ on #smc-project on Freenode

Expertise required: Basic understanding of golang and C

What the students will learn:


Improve the learning system

Project:

The main goal of this is to improve how varnam tokenizes when learning words. Today, when a word is learned, varnam takes all the possible prefixes into account and learn all of them to improve future suggestions. But sometimes, this is not enough to predict good suggestions. An improvement is suggested which will try to infer the base form of the word under learning.

Varnam has a learning system built-in which can learn words and it can also learn possible other ways to write a word. Consider the following example. 

learn("भारत") = [bharat, bhaarath, bharath]
transliterate("bharat") = भारत
transliterate("bhaarath") = भारत
transliterate("bharath") = भारत

Varnam also learns a word's prefixes so that it can produce better predictions for any word which has the same prefix. So in this case, with just learning the word "भारत", varnam can predict "bharateey" = "भारतीय".

The proposed idea talks about making this learn better. One example is infer the word "भारत" when learning भारतीय. Something like a porter stemmer implementation but integrated into the varnam framework so that new language support can be added easily.

Complexity : Medium

Confirmed Mentor : Navaneeth K N

How to contact the mentor: IRC - nkn__ on #smc-project on Freenode

Expertise required: Knowledge in C, Ruby (basics)

What the students will learn:


Word corpus synchronization

Project:

Create a cross-platform synchronization tool which can upload/download the word corpus from offline IMEs like varnam-ibus[2]. This helps to build the online words corpus easily.

Complexity : Medium

Confirmed Mentor : Navaneeth K N

How to contact the mentor: IRC - nkn__ on #smc-project on Freenode

Expertise required: Knowledge in C/golang

What the students will learn:


Adding Braille Keyboard layouts for Indian Languages to m17n Library

Project:

Project is building support for Bharati Braille keyboard layouts in GNU/Linux systemes. Bharati Braille standard is the official Braille standard in India. A regular QWERTY keyboard is used for data entry. SDF-JKL keys are used for six dots of Braille. This support need to be built as m17n layouts. This will enable visually challenged people who studied braille layouts to use GNU/Linux systems easily with the help of Audio feedback from TTS

More Details


Complexity :

Confirmed Mentor : Anivar Aravind

How to contact the mentor: IRC - anivar on #smc-project on Freenode

Expertise required:

What the students will learn:


Grandham

Adding MARC21 import/export feature in Grandham

We need a feature in Grandham to import and parse data from MARC21 documents. We should also be able to export existing data in MARC21.


Complexity : High

Confirmed Mentor : Ershad K

How to contact the mentor: IRC - ershad on #smc-project on Freenode

Expertise required: Knowledge in Ruby/Ruby on Rails

What the students will learn:


Projects with unconfirmed mentors

Retrieved from "https://wiki.smc.org.in/index.php?title=GSoC/2014/Project_ideas&oldid=4659"