Showing posts with label google. Show all posts
Showing posts with label google. Show all posts

Jul 29, 2014

An autonomous "data system" inspired by "life system" would look something like this-

Only if you could read between the megabytes!


We are probably living in the best times of history when it comes to freedom of knowledge. In very near future a storm of data is going to overtake individual supremacy and idiosyncrasies and going to demolish hard earned monopoly of handful of experts. Knowledge in form of data was never in such an abundance and never so easily accessible. Lets make use of it in best way possible.

A DATA SYSTEM INSPIRED BY LIFE SYSTEM  
- Has to be replicable  
- Has to be a Non
- Linear System  
- Has to be a Non-coplaner System  
- With a Beginning and End  
- Should mimic external environment without any  actual physical threat  
- Pyramid as building block with vital information  at its Tip and Archive at its base  
- Archive plane further arranged in segments of  24 or 54  
- Information tissue cubes made of 6 Pyramids  joined at Tip  
- Volume of Tissue cube arranged in 3d Grid  
- Vital information distributed in space  
- An auto learning system  
- Data mining with sixth sense filtering  
- With Functionally adapted parts  - Varying activity intensity  
- Available on Demand  - Customisable to Client's need without  intervention  
- Waste generation (junk) to maintain the  envisaged size of system  
- Idle period to revive and conserve energy  
- Alerts and Filters are key to system's tangible  success
- A mirror backup data-set-" Advantage over living  system"


Future of Data mining and Data analysis is here!

Author Brief: Anoop Jha is an Urban and regional Planner with a keen interest in exploring possible role of new Data and Technology in city, social, and economic planning and having vision to take planning to whole new level through integration of Policy, innovation and ever-growing knowledge base of world.


Join Anoop on Linkedin  
or follow on Twitter @urbanoregional


Jan 24, 2014

Unfathomable data: are you still scratching the surface?

Take for instance images!

If you have reached at the end of Google image search page, while looking for a random object or word like say "chair" and if you think this is it, here we are staring at the last image of  chair in world ever uploaded online and you start having this feeling that lets change the key word to "modern chair" and next  changing it to "modern designer chair" ; probably you are going in the wrong direction, probably you are approaching it too casually.  Online research is a  serious business whether its data or image. Its far easier to get lost or get disorientated in the   convoluted maze of online data while it needs a serious approach and focused objective to reach where you want to.

Just to get the hint of quantum of information that is floating out there freely online, if you are searching for any image for instance on Google you might get few hundred results now if you search using each of those images using this option called "search by image" you will get another few hundred distinct results for each original image now if you use a  combination of "search by image" and "text" -any text of your choice - you will get another thousand results now if you keep changing the text or combination of text you will keep getting different new results even if you don't change the image used in "search by image". Easy, we are not done yet. Now if you keep changing the "choice of  color" offered  by Google search results you will keep getting further unique results. Other option of image search is to use "random" text along with "text of your choice". 

Now another way is to search for photographs instead of images. Are they any different? Yes, and we are not even talking about twitter or instagram photograph;we are talking about photograph search through Google. Millions of photographs out there, all you have to do is to search for your  choice of text or subject with the several dozens extension names by which different brands of cameras save their files.

True, while still looking for chair, you might not get only "chair" in your search results if you search using above methods but possibility is that you might come across things in course of your search which will inspire you to the core and which might give a whole new direction and meaning to your research, which you can call accidental learning. We haven't  talked about ever flowing ever growing image database of flicker, twitter or instagram even. We haven't talked about text search yet.  

Its not just about research, its about the real fun part of it. Just take a dip in the unfathomable ocean of data its addictive. Be a smart netizen.


Join Anoop on Linkedin  
or follow on Twitter @urbanoregional


Jul 12, 2012

Why such vast gap exists in statistical interpretation of a single fact?


Statistics considers raw data while people tend to value associated sentiments.

If you are going for a primary survey with a standard template of closed ended questionnaires or some kind of table to be filled with numbers you might not be doing real justice to the survey. You might have a reasonable amount of data at end of the day to conclude your assignment or research, but you won’t be able to do the realistic assessment of the situation. You might fulfill the acceptable standards of data gathering; you might even publish the result and can even bag an award or two, but if the very people who got surveyed are not being able to relate to the statistical conclusion, or if they do not validate it, all the efforts of data collection and analysis goes to vain.

You will be surprised to realize that still at many instances the situation shown of paper and the actual situation experienced by the population is drastically different, though data for situation analysis was gathered from the same population or community. Then why this vast gap of interpreted and locally experienced situation exists? Why this constant apparent difference of opinion between government’s point of view and what media and NGO’s showcase about the city, region or community etc. There are few possible reasons, first is that statistics is very flexible domain, though outcome seems very impactful there is enough scope to mould or influence the direction of outcome, still staying within legally of intellectually acceptable limit. The kind of data you select to gather, variety of assumptions you take into consideration, mode and tool of statistical analysis you choose to go with, time span considered for analysis, selection and heterogeneity of sample itself, there are so many such variables that one can interpret and influence the outcome in any possible direction depending on the purpose or intention. Larger the data set, greater the flexibility of interpretation.

Government being a powerful entity with ample manpower and resources has generally upper hand when it comes to data collection and interpretation and usually less probability of misrepresentation, but again it depends on what they want to prove or convey. Media and NGO who generally lack enough data due to manpower constraint to prove a fact applicable to a larger domain generally tend to rely on emotional values attached to the subject or region and sentiments of population or communities to prove their point. They generally choose small set of data though having high perceived or emotional value and exploit the associated sentiments. On one hand there is ample scope of playing with data and on the other hand equally or more or less scope to play with people’s emotions and sentiments but ultimately both leads to distortion of fact. And this show of constant blame and justification goes on and on. Actual fact seems to lose the significance while this argument is on, later no one really bothers to reach to the actual fact.

Unless statistics as a knowledge stream would device a method and make it a mandate to consider or quantify and incorporate the emotional and sentimental values attached to the subject of research and aspirations of communities to the extent possible along with some kind of post analytic appraisal and indigenous validation method, data representation would remain deceptive and at the mercy of decision making individuals or groups. Meanwhile we as a layman can mitigate this doubt of data misrepresentation by keeping a questioning, skeptical or neutral attitude towards impactful data being presented day to day from both government end as well as media and social welfare representative’s end, without being panicked, without arriving at immediate conclusion, cross verifying the fact from different sources, applying our own head and intuition, knowing and reminding them that their job is to inform us not to instigate or incite us. You are capable enough to judge yourself; all you need is a fair amount of fair data and statistics or simply a fair representation.

By : Anoop Jha

May 27, 2012

Google - Data for sustainable planning!!



Internet has changed the process and pace of planning in the recent years, still leaving immense untapped possibilities and Google has played a crucial role in all this with constantly evolving its interface, data structuring and data liberalisation. Its up to us how sensibly we derive the hidden treasures and pattern of data and use it for better planning, leading to sustainable communities.