Telecommunications

Expand all | Collapse all

Working with Raster instead of Vector data?

  • 1.  Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 02-15-2018 14:06

    In GIS raster data and vector data both represent features in a map. Vector data does this by creating lines, points and polygons, the vertices of which are digitised as accurately as possible to outline or pinpoint the feature. It can be an accurate way of representing map features. The downside is if a large number of features need to be mapped the files can become large in size. Large vector files can consume a lot system resource in order to render on screen, also, editing and spatial queries can become memory intensive.

    Enter raster data. In these situations raster data can be used to speed up rendering and querying dramatically. In this example, the vector data represents a network coverage map. The prediction used to generate these maps also work using raster data for the aforementioned reason. Generally these raster coverage maps will be vectorised so they can be used in GIS systems as this is generally considered the default format to use. This creates a much larger file that may need to be split and tiled for different regions in order for the GIS to handle the entire dataset effectively. 

    Using raster handlers means this raster data can be opened in its native format without the requirement for conversion to vector format. This on its own reduces the workflow steps.

    As an example below, the vector map opens quickly and can be drawn on screen in seconds, but performance degrades when zooming and panning. In this case point in poly queries are not practical without splitting the dataset in to smaller regions as the map is made up of nearly half a million complex polygons and will be run against 1.5 million address points. The result would be a point in poly query showing all addresses that fall within a polygon with the attribute “No Coverage”. This allowing a sum of the population not covered to be calculated. Unfortunately using these two vector files it is not feasible to return the result in a practical time.

    See Attachment

    The same coverage map as a raster file is not only much smaller in terms of physical file size, but far more efficient to render on screen and query.

    The raster version takes less than one second to render in the map window. To run the equivalent of a point in poly query the Raster operation Point Inspection can be used. The Point Inspection operation applies the underlying raster cell value to the overlying point. So in this example, it will assign the predicted coverage value for that address to a new column in the address point file. The vector address file can then be queried easily using SQL Select to find only the addresses not covered by the network and the count.

    See Attachment

    In this example the Point Inspection takes 42 seconds to assign 1.5 million addresses a network coverage reading of either No Coverage or Good Indoors and Outdoors. A quick Filter using the browser can then be applied to query only the addresses not covered by the network.

    See Attachment

    The resultant query shows the addresses in green, they can be clearly seen to sit inside the areas of the coverage map that indicate No Coverage in red.

    See Attachment

    This process takes less than a minute, using vector data the process needs to broken down it to multiple steps and processed over a much longer period of time. The raster method opens up new ways to query large datasets without complex work processes.

    (The network used in this example is fictitious data)



  • 2.  RE: Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 02-20-2018 06:54

    Thanks Chris for showing the immense potential in the Raster formats.



  • 3.  RE: Working with Raster instead of Vector data?

    Posted 04-30-2018 05:30

    I’ve been working with coverage maps for mobile and fixed telecoms for many years. It is certainly true that raster has come on a long way over the past decade. Several industries have needed to work with larger rasters, so better methods of handling them (tiling, pyramids, compression, etc.) have been developed and implemented. Computers with ever-increasing working memory has also helped.

    The choice between using vector and raster for telco coverage is often a fine line. While the output from radio planning tools is usually raster, there are operations such as reprojection which are computationally expensive. So, if someone’s use case needs that (perhaps aggregating international coverages normalised for roaming purposes), vector may still be a better choice.

    The complexity of coverage data is also down to the maturity of a network. Several years ago, I presented a session at GITA which talked about this. During the early stages of a network deployment (a new provider or perhaps new generation of technology), coverage is minimal – perhaps a few a small number of city islands. Vector is better for that. During widespread rollout, those islands join up and you get rather complicated patterns. Raster is perhaps now a better option. A “bumpy” country where physical features and population distribution means that even “finished” coverage has these complications. Small, flat, dense countries end up almost being a single polygon and vector once again becomes best. e.g. Singapore, where the local regulator makes it a requirement for 100% coverage by all operators.

    /Warren



  • 4.  RE: Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 04-30-2018 06:09

    Thanks for your insight Warren. I agree, it is a horses for courses type situation as you say, the end application should always be considered when making the choice between data types.



  • 5.  RE: Working with Raster instead of Vector data?

    Posted 08-27-2018 03:46

    Thanks for sharing and interesting discussion.

    Not only the output from? planning tools usually are in raster format, but also the input data. Terrain/height data and clutter (landuse) data are often in raster format to get a continous data. With higher frequencies and denser networks the need for better resolutions has lead to larger and larger file sizes. The demand in the market is going towards at least 10m raster for whole countries. Until the introduction of the mrr-format this was becoming a real obstacle for us to handle. But as you mention Warren, this has greatly improved in the last couple of years



  • 6.  RE: Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 09-03-2018 11:17

    @Johan Frossling?  thanks for your comment, this is what we see from our customers too. The land class/use data raises an interesting discussion too, what is deemed relevant accuracy from this point of view, what granularity is required? What would be too much/too little detail, what would be considered the appropriate scale going forward looking at ever increasing deployment of small scale networks? At the other end of the of the spectrum there is the narrow band IOT deployments. Lot's of different technologies and more coming online as we go forward, is the multi resolution raster format that has the ability to hold multiple rasters in a single file be potentially useful here? The ability to handle multiple different datasets together in multi-banded raster file?



  • 7.  RE: Working with Raster instead of Vector data?

    Posted 09-11-2018 09:27

    @Chris Jenkins? Yes there is always the balance to find the most cost-effective data for each scenario. We really do not want more detail than needed, since details usually are connected to higher cost and production time?. So as you say we are a looking at using different resolutions for different areas (core urban area, suburban, rural) where one can deploy different types of networks/technologies, in which case the multi-resolution capability is very handy.



  • 8.  RE: Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 11-18-2018 17:45
    We are incubating a new capability that will provide an alternative solution to multi-resolution MRR's.

    In the scenario mentioned, where you have raster based signal strength (or something) data for somewhere like the US. You might have high-resolution data for cities, medium-resolution data for rural areas and low-resolution data for outback regions. Currently, we have customers bringing all this data together into a single multi-resolution MRR. This requires reprojecting everything to a geodetic coordinate system and you have to worry about what all your processing is doing to your data quality.

    I have always believed that the best solution is to minimise the amount of processing to maximise data quality. That means building high-quality rasters in the first place, and then leaving all the rasters alone and in a projection (UTM or something) that best suits the data. How then to bring them all together?

    We have a new capability called a "MapInfo Virtual Raster". It is an XML file that will be able to bring together rasters in different projections and different resolutions together in real time for visualisation or processing. If, for example, you want to look at this raster collection for some local area like a city, you can work in a coordinate system that is suitable for that city, thus obviating the need to reproject the raster data that provides coverage of that city, and thereby maximising your data quality and confidence in your analysis.

    Virtual rasters are being released as a preview in MapInfo Pro 17 (Patch 2 in December 2018) to do certain things, mainly to improve our multi-spectral rendering capability. In future versions of MapInfo (2019) we will be releasing a greater range of capabilities in this space.

    ------------------------------
    Sam Roberts
    LI Community Shared Account
    Shelton CT
    ------------------------------



  • 9.  RE: Working with Raster instead of Vector data?

    Posted 14 days ago
    Hi Sam.
    It seems I missed your reply almost a year ago :-)
    Any update on this functionality. Not sure I see the use case for us, but it might have been developed.
    Thanks
    /Johan

    ------------------------------
    Johan Frossling
    Manager
    ERICSSON AB
    Stockholm
    ------------------------------



  • 10.  RE: Working with Raster instead of Vector data?

    Pitney Bowes
    Posted 12 days ago
    There are a few articles in the MapInfo Pro group that discuss the MVR (MapInfo Virtual Raster) technology.

    Virtual Raster Deep Dive - Part 1 - What is a Virtual Raster? (link)
    Virtual Raster Deep Dive - Part 2 - Satellite Multispectral Imagery (link)
    Working with MapInfo Virtual Rasters (link)
    Polygonising an Image raster using Virtual Rasters (link)

    It is being actively developed with new features coming in MapInfo Pro 2019 and new features already ready for the first 2019 patch.

    Even so, it is still barely exposed in Pro. There is a UI tool to create simple MVR's. You can also generate an MVR from the Warp Image tool. In Pro 2019 you will be able to run a Convert operation on an MVR but we still restrict processing operations on MVR in general.

    ------------------------------
    Sam Roberts
    Engineer, MapInfo Pro Advanced (Raster)
    Australia
    ------------------------------



  • 11.  RE: Working with Raster instead of Vector data?

    Posted 11 days ago
    Thanks Sam.
    Will go through this material and learn something new.

    ------------------------------
    /Johan Frössling
    Team Leader - Geodata SME
    Ericsson AB
    ------------------------------