d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Your Opinions On This Projects Scope?
12Next
Add Reply New Topic New Poll
Member
Posts: 29,345
Joined: Mar 27 2008
Gold: 504.69
Aug 4 2016 01:31pm
A lot of data currently resides in a number of Excel sheets.
Rough estimate 100 rows x 80 columns, across 3-5 spreadsheets. A lot of data repeated.

I feel like the data would be more easily accessed and manipulated if it were to reside in a database with some sort of companion application.

What, in your opinion, would be the cost and deadline for something like this if you were to pay someone else?
Would you, in your opinion, develop this in house?
Would you even develop this at all?
ISO opinions.
Member
Posts: 8,112
Joined: Sep 23 2006
Gold: 3,558.23
Aug 4 2016 02:37pm
I guess it would depend on who asked for it. I mean, it's not that much data, but if a director is crying for it to have a web front end...

If you've already got a small database in existence, why not add a few tables to hold this data? We would do this in house, we've got two great SQL admins, and two great web programmers who could probably whip this up (along with queries) after about ~20-24 man hours. But that's with the infrastructure already in place.
Member
Posts: 29,345
Joined: Mar 27 2008
Gold: 504.69
Aug 4 2016 04:28pm
Quote (Qord @ Aug 4 2016 04:37pm)
I guess it would depend on who asked for it. I mean, it's not that much data, but if a director is crying for it to have a web front end...

If you've already got a small database in existence, why not add a few tables to hold this data? We would do this in house, we've got two great SQL admins, and two great web programmers who could probably whip this up (along with queries) after about ~20-24 man hours. But that's with the infrastructure already in place.


Thank. That helps me put the project into context.

No current infrastructure aand it would basically be me doing everything.
Member
Posts: 32,925
Joined: Jul 23 2006
Gold: 3,804.50
Aug 4 2016 05:21pm
sounds pretty simple to move it into the db. just import it into a database (dont need to write a custom app), run a few sql for any cleanup to remove duplicate data.

as for the front end, django has built in CRUD. could whip up something basic with very little code if you know what you're doing.

the downside of these projects is they never end. as soon as you give users a better view, they'll bug you for features and support. personally, i'd leave it in excel and let them user filters / charts, write macros / pivot tables and whatnot.

This post was edited by carteblanche on Aug 4 2016 05:29pm
Member
Posts: 29,345
Joined: Mar 27 2008
Gold: 504.69
Aug 4 2016 07:04pm
Quote (carteblanche @ Aug 4 2016 07:21pm)
sounds pretty simple to move it into the db. just import it into a database (dont need to write a custom app), run a few sql for any cleanup to remove duplicate data.

as for the front end, django has built in CRUD. could whip up something basic with very little code if you know what you're doing.

the downside of these projects is they never end. as soon as you give users a better view, they'll bug you for features and support. personally, i'd leave it in excel and let them user filters / charts, write macros / pivot tables and whatnot.


This is what I was thinking as well. There is another factor that I have to consider. I'm only an intern and my time is ending soon.
Member
Posts: 36,389
Joined: Jul 18 2008
Gold: 3,192.00
Aug 5 2016 06:58am
Honestly, this could be done in a couple days wit like a python or perl script. Just use excel to export as CSV, use a script to parse the CSV and insert into database.

If this is something you want to try doing yourself I would start looking into RegEx's
Member
Posts: 38
Joined: Aug 17 2016
Gold: 0.00
Aug 21 2016 10:05am
FYI, that is not remotely near being a lot. Meaning that
Quote (carteblanche @ Aug 4 2016 04:21pm)
sounds pretty simple to move it into the db. just import it into a database (dont need to write a custom app), run a few sql for any cleanup to remove duplicate data.

as for the front end, django has built in CRUD. could whip up something basic with very little code if you know what you're doing.

the downside of these projects is they never end. as soon as you give users a better view, they'll bug you for features and support. personally, i'd leave it in excel and let them user filters / charts, write macros / pivot tables and whatnot.


this is key. perhaps providing them a simple interface in Excel where they have control would be better
Member
Posts: 20,253
Joined: Apr 30 2008
Gold: 5,267.97
Aug 22 2016 01:36am
Honestly, just get your hands on Microsoft Access and see how far it takes you. You have too much data for an Excel file, but using actual databases for this is serious overkill.
Member
Posts: 18
Joined: Aug 31 2016
Gold: 10,000.00
Sep 1 2016 12:58am
Not much data in my opinion.
Member
Posts: 37
Joined: Aug 2 2016
Gold: 0.00
Sep 9 2016 04:31am
Quote (UCFSON @ Sep 1 2016 08:58am)
Not much data in my opinion.


I agree.

100 rows is like nothing. you could type those in an hour.
80 columns sounds like a lot but it is not.

The only thing 80 columns does, is raising an anti-pattern" alert. In this case there is probably data in each row that could be moved to a separate dataset. one would want to do this to minimize redundancy and improve maintenance quality.

I think that a very important aspect of automation is in analyzing the process.

Instead of thinking bout migrating your project (excel spreadhseet ) to another system, try to find out what people are trying to do, and how you could simplify the process.
Sometimes the usage of spreadsheets can be left out altogether.

And programming an application is easy. Telling what the program should do is a lot harder. You should be able to roughly estimate how long it will take, If you cannot, you might want to gain more insight on the process, before proposing to migrate.
Go Back To Programming & Development Topic List
12Next
Add Reply New Topic New Poll