@prajwal27 Very much Thanks for your suggestion, but I can’t use it because it stores data in key value pair, just like shared preference in android.
I can’t perform query on data with this because it stores data in key value pair. It’s good for storing small data, but here when user searches for any procedure , I need to perform query on the data. So, I need to use sqflite
Please keep discussing with me if you find interesting stuff
In the future, please create issues for what you are working on, and then make commits/MR against an issue. That it was it is trackable and we know what features you are working on.
I have closed that MR with conflicts and opened another MR with the changes you have asked for,
Also I have to combine all the jobs to a single job in CI Pipeline because whenever a new job starts it starts from scratch & cannot use data from earlier job. It can use Artifacts but instead of this I combined all jobs to single.
@Darshpreet2000I left some comments on the repo… @r0bby could we make the develop the main branch and master contain all the data. Imagining me forking repo with so much data. So here is what I propose @Darshpreet2000
Restructure your repo and also include a .gitignore and Readme.md/rst
Remove the CMD/data dirs (these can be created on the fly during init or checked if existing) as this will be on the master branch, nobody needs the burden of having all that data on first fork.
The urls plug can come in handy for just adding the url of the hospital you need. We may think of a better configuration for that
Ideally your repo should just be a scrapper that saves files here and there when needed and these data doesn’t need to be committed
It will be easier to make modifications to the codebase and follow along knowing we are scrapping the correct data. Also you can run the pipeline with the master/develop how you chose. MRs made to the develop branch will then be merged and each time merged, CI does its job.
I have ran your code and works pretty well, I just need url of one hospital to test it works. Haven’t checked code style though will do and also comment code when necessary it is easy to follow along