Recently, someone in the Cardiff u3a Lightroom Pantry group asked me this question …
Sorry to bother you, but I’m running out of hard drive space on my Mac, can I delete any of these files? I’m wondering about the previews file????
The first thing to say is that the user is storing images on an external hard disk, just the catalog and previews files etc. are on the internal hard disk. So this text from a post from a Lightroom Queen Forum is helpful …
Unless you have a laptop and or your images on an External drive, you don’t really need Smart Previews, standard Previews will grow unless you limit the number of 1:1 preview to 30 days. Deleting images does not immediately delete the previews though I think it will eventually.
If you upgrade to LrC v14.01, you also now have the option to limit the size of standard previews not exceed 100 or 150 GB or what number that you set. LrC will the delete previews beginning with the oldest and starting with the 1:1.
I have about 82,000 images in my master catalog and a standard preview size of 41GB. On import I generate minimal previews, no 1:1 and have 1:1 previews set to delete after 30 days. I have not (yet) set a limit on the size of my standard Previews.
So the user should use Smart Previews as they have an external hard disk holding their images.
They should also look at the Import parameters for Previews (in the top-hand corner of the screen) in the Import dialogue and choose Smart Previews. They should also NOT use 1:1 Previews as they take-up more room on their hard disk, and should choose Standard Previews. This is my setting box …
Finally, the user (and you maybe) should look at the Catalog Settings > Preview pane which might be a way of restricting the growth of the Preview file (as mentioned in the Lightroom Queen Forum) …
An important fact I forgot to mention (which again was mentioned in the LrQ Forum post) – you can delete the Preview file; it will just be recreated as needed (it takes a very short time to recreate a preview of an image). Limiting the size of it will certainly ensure that the disk space used will be less, and if they create 1:1 previews in the future, deleting them after 30 days (as I have it set) will ensure that disk space will be controlled too.
Another member challenged me on why (see Import settings above), I chose to Make a Second Copy of images when I import. My response …
It’s a timing issue. I don’t keep SD cards with images on them – I know some of you do. I Format the cards in Camera (not on the computer) almost immediately after I’ve imported. [That stops the rather annoying feature of images you’ve previously deleted in LrC being suggested for Import when Import All is selected in the dialogue.] So … I need a belts and braces facility in place, just-in-case, my internal hard disk crashes before Time Machine has backed-up my current year images. So I do a Second Copy to my iCloud drive, which I delete periodically, usually at the same time as I delete old backups of catalogs which are also held on the iCloud drive.
Next we turn to the range of tasks that I do every year at this time – as the year ends and a new year begins.
The first thing to state (and a very obvious one at that) is Backup your Catalog, and then continue to Backup your Catalog as you try some of these ideas out. That will mean exiting Lightroom Classic and NOT skipping Backup. It’s better to be safe than sorry!!!
So what might you wish to do when Importing images into your catalog?
Two things really, first creating a “preset” for the Metadata that you’d like to import with every image which will then be baked into the EXIF data of the image. The second is the Preset itself which records the action that you wish to take on each Import eg where the images will be stored, in what form, renaming them, making a second-copy, profile changes, etc etc.
Let’s look at each in turn.
You want to add to the Metadata added to the image at the time of import, to add keywords, or to add a Copyright notice. This can be done from the Metadata pull-down menu in the right-hand Import panel …
Screenshot
… and here you have a whole range of options that you can choose from with perhaps the most relevant being the Copyright info. and any info about you you want added …
Screenshot
… so my Copyright info, and the only ones I use in the Metadata, and which I update each year before January 1st looks like this …
Screenshot
… and that’s about it. I enter MLT Copyright 2025 in the Metadata field in the right-hand pane and move to the next step – creating an Import Preset.
Click on the Import tab in the Library module; apart from deciding whether you want to …
NB I almost always choose Copy
… you will see at the bottom of the screen the word None …
You click on “None” to see the range of Presets you can deploy
… unfortunately, this will always be the case; it’s up to you to now create, and then choose the Import Preset you want to use. This has its advantages because you can change the one you want to use by year, by camera, by anything.
So, you set up the parameters from the right-hand pane the way you want them and then click on None and …
Screenshot
… Save Current Settings as a New Preset, and you’ll be asked to give it a name, and that’s it. Every time you want to apply these parameters to an Import, that’s what will happen. The files may be renamed (if that’s your wish), they will be copied to a specific folder on your hard disk, etc etc.
Other tasks to do at year end.
Search for missing files (these will be photos in the catalog, but not in folders -they’ve probably moved!)
Searching for duplicates – The Lightroom Queen has an excellent post on this topic which I can’t improve upon and recommends a plugin (which I have used) which in the case of simple duplicates works well.
For more complicated duplicate problems – perhaps involving whole folders of potential duplicates, its probably far better to use an operating system program such as dupeGuru (MacOS and Windows) or Photosweeper (MacOS) – there are others for Windows that I haven’t tried. I’ve tried both but prefer dupeGuru as it allows you to do a quick sweep by EXIF data, and Content of Pictures specifically.
One suggestion I have is to separate folders into catalogs and Export as Catalog before doing any scans for duplicates. When you have a folder that you think is clear of duplicates chose Import as Catalog from the Library > File menu, and when this has been achieved, delete the original folder.
This links to another feature that I rally hadn’t appreciated until I read this article. Rather than doing move of files/folders INSIDE Lightroom (which is the accepted wisdom to maintain the integrity of the catalog) – which can take a really long time and which is also potentially dangerous in terms of file corruption, use Find missing folder. You chose the old folder in the Library and then point (by right-clicking) to the new folder you’ve just imported.
Backup
All of the above was a preface to doing the real annual task which is creating an offsite backup which up until this year was copying all the images and the catalogs onto a hard disk that I stored in my son’s house nearby. This was the safe/secure disaster recovery option which meant that all my historic images would be safe.
In doing this work, this year, I realised that I’d probably not been as clever as I could have been, and in copying images and catalog(s) separately, I’d been missing a trick. It became obvious to me (light-bulb moment) that I should Export as Catalog (Catalog + Images) to the Hard Disk. This then led to the realisation (second light-bulb moment) that I was keeping a large number of old catalogs, for previous versions of Lightroom that I would never go back to, because if I stopped my Photographic Plan subscription I would still have access to the Library module. Why would I want to go back to an earlier version!
I was on a roll now and looked at other people’s backup strategy. Yes, I was doing the right thing in having a 3-2-1 approach – three backups, two locations, one offsite, but was I really doing the most efficient and most effective form of backing-up. Perhaps (third light-bulb moment) it might be better to clone my Lightroom folder(s) overnight – so that I could quickly recover in the case of primary internal hard disk loss – instead of relying on rebuilding from Time Machine and iCloud Drive; and perhaps it might be better to look at Cloud storage for the offsite storage.
I’m moving closer to making a decision on this and if I do move in this direction I will probably use Carbon Copy Cloner (MacOS only) for cloning to a local hard disk, and Backblaze for offsite storage to the cloud, run overnight.
I’ll report on how I get on with this at a later date.
This post was first written for the Cardiff u3a Digital Matters group, and is copied here as it possibly has wider interest (??).
Updated 6th September 2024
A further update to comment upon our experience with Intelligent Octopus Flux. The change to the tariff went smoothly enough; the extraction from it to change to another one didn’t go smoothly, although I can’t fault the support from Octopus – just the documentation they had to follow to enable a move off the tariff. After a few weeks on Intelligent Octopus Flux, it became apparent that it might well be a good tariff for the winter (and for anyone not wanting to actively manage their solar and battery), but not necessarily for the summer when our solar power generation was at its optimum level. I won’t go into details – maybe another post sometime – but we moved on to Agile Octopus for Import and Fixed Octopus for Export, which enabled us to take advantage of both “plunge pricing”, and also allowed us to choose when to charge up the battery from the grid, and to what level. [This takes about 2mins each day after 16:00 when the pricing for the following day becomes available using this website – which gives the pricing of electricity from the grid region by region.] In summary, Intelligent Octopus Flux appears to maximise the benefit to Octopus by allowing them to use your battery for off-grid storage, and not enable the maximum charging of your battery. Good for the planet, but not necessarily good for the consumer with an investment in solar panels and battery.
Updated 18th July 2024
This post to accompany the presentation on 11th July could be sub-titled “The data driven house”; but most certainly not “The smart house” – it would be along-time before our early-Edwardian semi could even begin to compete in that category. However, over the last year we have move significantly to reduce our carbon footprint and I believe saved quite a lot of money off our household bills – at the expense it has to be said of a reduction in our capital. Spending the kids Inheritance so-to-speak, but with their full support and encouragement. So here goes …
A brief history of our energy in days gone by.
We’ve tried over the years to switch suppliers and have been with EDF, E-On before a long-stint with British Gas which we switched to when we got our first smart meter, partly on the promise of supplying us with a tool to monitor our energy usage in an app.
However the smart meter they supplied us with was a SMETS-1 one which was soon after our installation replaced in the national rollout by a SMETS-2 version – but not given to existing customers. We were assured that British Gas was working with the regulators to ensure compatibility which would also allow users to switch providers seamlessly – but this never happened. Whilst other suppliers (eg Octopus) have found a way of jury-rigging SMETS-1 meters to work with their smart tariffs, British Gas have done nothing. In fact our experience was even worse because after a period of time (perhaps a couple of years) the app ceased giving usage information to us. We pursued them for at least 18 months but eventually – disgusted with their lack of customer service and inability to respond to enquiries first, and then complaints, we decided we should move suppliers. Family members had already chosen Ovo, and Octopus, and on their experience and after substantial review and research, and also following the recommendation from Which? we chose to switch to Octopus using our existing SMETS-1 meter – with the assurance that we could, and would, be upgraded to the SMETS-2 system in due course. This meant initially we would have no monitoring locally, but we would have access to their excellent website to monitor our usage. We had to take quite a few meter readings during the switch-over period – presumably whilst they got their systems talking to our SMETS-1 meter -but we did the switch and joined their standard Octopus Flexible tariff.
Around about the same time we got confirmation that we would have to tackle the heating of the kitchen as Jenny had a confirmed diagnosis of a health issue that meant we would have to ensure the house was much warmer than it had been in previous years. [We have been extraordinarily fortunate that last winter must have been one of the mildest on record.] So we (or Jenny to be accurate) set about getting draft excluders, heavier lined curtains, the purchase of Chimney Sheep draft excluders, replacement of double glazing with triple glazing in the main rooms Jenny used, enhancement of the insulation in the space above the kitchen extension and … upgrading of the heating in the kitchen and garden room using Infra-red Panels.
These we researched on the recommendation of a friend who has started progressively to replace all the traditional gas-heated water-filled radiators in their house with IR panels.
We visited Herschel in Bristol. We were hugely impressed at the rapid and effective performance of the panels, the fact they could be mounted on the ceilings, or walls, or standalone, and that some could have pictures or even mirrors on them, and also the low power draw and the fact they could be controlled as smart devices. Herschel provided us with an estimate of the requirement to meet our needs. We asked them to provide details of a local approved installer, who we contacted (TEG) and who then came to do a site visit. They proposed a larger pair of panels than Herschel had suggested and furthermore suggested also fitting an IR unit in the garden room, which has not been used as yet, but it was logical to install it at the same time – future-proofing the back of the house in its heating needs..
View of kitchen triple glazed windows with IR Panel (1100W) in ceiling
The installer mentioned that he could provide good pricing on Solar panels and batteries and VAT-free panels if done as one installation. [It also has to be added that he was able to get the panels at discount from Herschel, so although the units could be installed by any competent electrician (or even me!) the purchase of the units was cheaper than if we had ordered direct.] We had experience soft-pressure from the family to “do something green” – so went for it realising that we could never recover the installation costs in our lifetime but we could reduce our usage costs which were heading towards £3,600 (British Gas) in our old Edwardian house and likely to go higher.
At this time I also researched whether an air source heat pump might be a good idea but determined that given the generally poor insulation of our old house, such a solution would not be a great idea, but that a gradual replacement (as my friend was doing) of replacing radiators with IR panels when a room was being decorated was the better way to go.
The installation of the IR panels, the solar panels and the battery was very professional and they followed my preference for siting of cable routing and units so that it was very difficult to see what had been done. The after-sales support, warranty and documentation they provided was excellent, and it’s comforting to know that Craig is just a WhatsApp call away and can monitor our system and make changes as necessary.
Enphase solar panels (5) on top roofSolar panels on kitchen extension (4) – solar panels on side (top) roof not shown (2)GivEnergy All-in-One Battery using micro-inverters (13.5kWh capacity)GivEnergy Gateway connecting Battery to Grid and to Household supply
When we had committed to the installation I also started pressuring Octopus to provide us with a SMETS-2 meter so that we could benefit from Smart Tariffs. They responded in a reasonable time (I suppose given the backlog of their work), but after continual pressure, the electric and gas meters were replaced, and we had new meters and the mini-hub – which allows the meters to communicate with the app on the smart phone/tablet – in place by late-October following a September installation of the solar panels and battery. Now the fun could really start!
Replacement SMETS-2 gas meter from OctopusOctopus mini-hub to connect smart meters to Home network for monitoring locally.
Choice of tariff
Octopus has many, many tariffs. It would be impossible to go through them here, but be advised that if you have an EV (electric vehicle), or a heat pump, there are tariffs for you. They also provide tools to help you decide which tariff is the right one for you. We however were only interested in those that worked best with our solar panels and battery. The obvious one for us to start with was Octopus Flux. This had the benefit of allowing us to charge our battery up to its maximum for a very low rate between 02:00 and 05:00 and enable us to discharge from the batter gradually through the day whilst with the management of the GivEnergy battery we could ensure that there was a full battery for the hours of 16:00 to 19:00. It also ensured that the battery was full when we most wanted heat from the IR panels so we set them to kick-in at 04:00 in the morning and with scheduled time periods arranged for them to be on (subject to the temperature not exceeding the threshold) when we needed them on.
Herschel Plugin WiFi Thermostat and Govee smart temperature device to check thermostat
Monitoring, reduction in monthly direct debit
I started an intensive monitoring of our electricity usage, changing the various settings possible on the GivEnergy Dashboard
The dashboard control for the inverter and batteryScreenshot of what is happening to your GivEnergy Battery on the web dashboard
I won’t detail the experiments and changes I tried. Suffice to say it educated me about how the system could work and what I needed to consider to get optimum benefit from the system/installation. I was also very soon able to reduce the monthly direct debit that we were paying to Octopus from the initial figure they suggested (when on the standard Flexible tariff – which in itself was less than the £300 that BG had wanted from us) to now £200 a month – and we’re over £600 in credit at the moment. So an immediate 33% reduction in our energy costs – but it could be more!!!
Octopus Flux pays you when your system exports to the grid. The payment you get is less than the amount you’re paying for the import of power into the household. Last year Octopus introduced a tariff that was the same for import and export, which meant that charging the battery at a fixed time no longer was necessary and that you could get a higher payback for export during the grid high-demand period of 16:00 to 19:00. So it seemed a tariff I should try out.
We’ve been on this tariff now since May and I have had some issues with understanding how exactly it works, but essentially you’re letting your battery be controlled by Octopus and become part of the National Grid. I don’t have any difficulties with that after learning that the grid is just one huge battery effectively and that the cable that feeds your house doesn’t effectively belong to anyone except the National Grid (or its surrogates). However I’m having a dialogue with them currently on the range of battery charging/discharging they’re deploying and whether it’s too narrow. When I was on Octopus Flux I was charging the battery to 100% between 02:00 and 05:00, or something less if there was a lot of sun expected in the day, and discharging down to as low as 4%. Currently Intelligent Octopus Flux appears to be only operating in a range of 55% to 77%. I’m asking them why??
The upshot of this is that if you’re prepared to be an active battery monitor, it might be worthwhile to be on Octopus Flux, if you’re passive (or just want to save the planet), then Intelligent Octopus Flux is the one for you. I suspect a combination is best for us with Octopus Flux in the winter 6 months, and Intelligent Octopus Flux in the summer 6 months. Especially if I can combine it with smart monitoring for the winter months. Watch this space!!
For completeness, the screens from the various apps I’m using …
The apps I use in the HomeThe control screen for the IR panelsThe settings screen for the IR panelsGovee smart temperature and humidityGovee dashboardGivEnergy app DashboardGivEnergy app power consumption screenGivEnergy app power graphGivEnergy app customising optionsEnphase app solar panel power productionEnphase app – power production graphOctopus app – recording power usage
Update – 18th July 2024
In the meeting I mentioned that we were having some outstanding issues in respect of the Tariff we had decided to move on to – this was a move from Octopus Flux (import and export) to Intelligent Octopus Flux. This move just didn’t work for us. We had to give up control of our battery to Octopus and it began to emerge that they were manipulating the settings to maximise operational benefits for themselves. We might have got some small financial benefit over standard tariffs, but not really very significant ones.
We’ve now changed to Agile Octopus for Import and Octopus Fixed (12m) for Export. As we don’t really want to export energy, but maximise the use of our battery, this makes much more sense. The very low Import rates on Agile we can utilise to charge our battery – something which wasn’t happening the way we’d wanted it to on the other tariffs.
So hopefully a closed chapter – I’ll of course update you on any subsequent developments.