John Main Logo

John Main

Code. Design. Hosting. Maintenance.

01
Nov '18

Ok many of you may already know this one, but it’s a relatively new one to me, and since non-HTML5 browsers are now mostly gone the way of the dinosaur, I’m much more comfortable relying on its elements for my core functionality. If you are still on IE9 or below then you deserve all you get!

This is as simple as I can make an AJAX form submission handler, that will also deal with files. It uses the HTML5 FormData object to serialise all the form data, including files, and allow us to pass it with the AJAX POST request.

$('.my-form').on('submit', function(e) {
var form_data = new FormData($(this)[0]);
$.ajax({
type: 'POST',
url: $(this).attr('action'),
data: form_data,
dataType: 'json',
cache: false,
contentType: false,
processData: false,
success: function(response) {
// Wahey!
},
error: function() {
// Oh dear
}
});
return false;
});

The ‘cache’, ‘contentType’ and ‘processData’ flags ARE necessary to make this work properly. The ‘dataType’ is optional, but if your server doesn’t send back JSON in response to an AJAX request as standard then you need to have a word with yourself!

Also notice that the FormData object needs the DOM version of the form, not the jQuery object, hence the need for “$(this)[0]” in the constructor.

Job. Done.

25
Jul '18

I know I know. Rely too much on traits and you’re asking for trouble. But when used correctly, for self-contained bolt-on functionality they really can be fantastic and save loads of time.

There only condition for this logic is that any record with which you are using this must have a ‘logo’ field. Yeah I know I could have done a more advanced version with a separate logo table and a polymorphic relationship, but it’s not like a standard system will have 2 dozen records that all require logos against them so I’ve kept it simple.

I’ve used the word ‘logo’ here, but it’s a generic image storing trait and could be used for anything. You’ll also notice an optional config option of ‘app.directory.logo’, which, if provided, will be used as a relative path below the application’s public folder, otherwise ‘/logos’ will be used.

This assumes that you have an image referenced as ‘logo_file’ in your request and have triggered a save on the parent record.

namespace App\Trt;
trait Logo
{
/**
* Custom boot method
*/
public static function bootLogo()
{
/*
* Trigger on save
*/
static::saved(function ($record) {
try {
if(request()->hasFile('logo_file') && request()->file('logo_file')->isValid()) {
$logo_file = request()->file('logo_file');
$logo_folder = public_path(config('app.directory.logo', '/logos'));
if(is_dir($logo_folder) && is_writable($logo_folder)) {
//Prepending the record ID to ensure uniqueness
//Could also prepend parent record type / sanitised model name if it's to be used for multiple records
$file_name = $record->id . '_' . $logo_file->getClientOriginalName();
$record->clearLogo(false);
if($logo_file->move($logo_folder, $file_name)) {
$record->logo = $file_name;
//Direct update here so we don't trigger any callbacks
\DB::table($record->getTable())->where('id', $record->id)->update(['logo' => $file_name]);
}
}
else {
\Log::error('Logo folder is not writable ' . $logo_folder);
}
}
elseif(request()->clear_logo) {
$record->clearLogo();
}
}
catch(\Exception $e) {
}
});
/*
* Trigger on delete
*/
static::deleting(function ($record) {
$record->clearLogo(false);
});
}
/**
* Check for logo
* @return boolean
*/
public function hasLogo() {
return ($this->logo && is_file($this->logoPath()));
}
/**
* Logo URL
* @return string|false
*/
public function logoURL() {
return $this->logo ? url(config('app.directory.logo', '/logos') . '/' . $this->logo) : false;
}
/**
* Logo Path
* @return string|false
*/
public function logoPath() {
return $this->logo ? public_path(config('app.directory.logo', '/logos') . '/' . $this->logo) : false;
}
/**
* Clear Logo
* @param boolean [$save=true] Save
* @return boolean
*/
public function clearLogo($save = true) {
if($this->logo) {
if($this->hasLogo())
unlink($this->logoPath());
$this->logo = null;
if($save)
$this->save();
return true;
}
return false;
}
}

And that’s it!

01
Jun '18

I’m sure we’ve all been there. You create a nice data structure for a utility and the client says “Ok, but I also need to be able to add a note to it”. You add a note field and then they say “Ok, but I also need to add a note over here”. You add another note field over there and then they say “But I need to be able to add new notes and keep the old ones”. You scream internally, wish they’d told you that in the first place, and start building a more flexible solution.

Well here is my take on it. It’s a separate notes table with a polymorphic association to any and all other records. Their models simply need to use this ‘Notable’ trait. The notes will be created automatically with any save action on the parent model, and have a simple functions to retrieve all notes against a parent, or clear them. Simples.

This assumes that you have either a single ‘note’ parameter in your request, or a ‘notes’ array, and have triggered a save on the parent record.

Table structure:

CREATE TABLE `notes` (
`id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`parent_id` int(11) NOT NULL,
`parent_type` varchar(255) COLLATE utf8_unicode_ci NOT NULL,
`content` text COLLATE utf8_unicode_ci NOT NULL,
`created_at` timestamp NULL DEFAULT NULL,
`updated_at` timestamp NULL DEFAULT NULL,
PRIMARY KEY (`id`)
);

Trait:

namespace App\Trt;
/**
* Notable trait
*/
trait Notable
{
/**
* Custom boot method
*/
public static function bootNotable()
{
/*
* Trigger on create
*/
static::saved(function ($record) {
//We check the class name here as otherwise it will get in an infinite loop of trying to add notes below notes
if(class_basename(get_class($record)) != 'Note' && (request()->note || request()->notes)) {
if(request()->note) {
$record->notes()->create(['content' => request()->note]);
}
if(request()->notes && is_array(request()->notes)) {
foreach(request()->notes as $note) {
$record->notes()->create(['content' => $note]);
}
}
}
});
/*
* Trigger on delete
*/
static::deleting(function ($record) {
$record->clearNotes();
});
}
/**
* Note relationship
*/
public function notes()
{
return $this->morphMany('\App\Model\Note', 'parent');
}
/**
* Clear all notes
*/
public function clearNotes() {
$this->notes()->delete();
}
}

I tend to include the ID of the current user in the note too, so that I can display the user name against the note text. Simple case of adding the column to the table and the fillable array, adding the relationship function, and replacing:

$record->notes()->create(['content' => request()->note]);

with:

$record->notes()->create(['content' => request()->note, 'user_id' => \Auth::user()->id]);
15
Apr '18

One of my projects features a survey / audit system for which I was tasked to provide an offline facility by allowing the download of fillable PDF forms, and then the subsequent re-upload and processing of them.

For the form generation and download I built a wrapper around TCPDF, which I may blog about one day, but it was an extremely involved process and today is not that day!

The import and processing routine I implemented using TCPDF (specifically this PDFTK library aliased as ‘PDFTK’ in my app configuration), and ended up being nicely self-contained:

/*
* Read fields from PDF file
* @param string $path Path to PDF
* @return array
*/
public static function read($path) {
$pdf = new \PDFRead($path, ['_command' => '/usr/bin/pdftk']);
$ignore_fields = ['Validate', 'Submit', 'Reset', 'Print'];
$ignore_values = ['Select...', 'Off'];
if($data = $pdf->getDataFields()) {
$values = collect($data->__toArray())->mapWithKeys(function($data_field) use ($ignore_fields, $ignore_values) {
if(in_array($data_field['FieldName'], $ignore_fields))
return [];
if(isset($data_field['FieldValue'])) {
$value = $data_field['FieldValue'];
if($data_field['FieldType'] != 'Text' && in_array($data_field['FieldValue'], $ignore_values))
$value = '';
}
else
$value = '';
return [$data_field['FieldName'] => $value];
});
$parsed_values = [];
foreach($values as $key => $value) {
if(preg_match('/(.*)\[([0-9\_]+)\]/', $key, $matches)) {
if(!isset($parsed_values[$matches[1]]))
$parsed_values[$matches[1]] = [];
$parsed_values[$matches[1]][$matches[2]] = $value;
}
else
$parsed_values[$key] = $value;
}
return $parsed_values;
}
}
Pass any filled PDF form through that function and it will return an array in the same format as you would get from any normal form submission.
27
Mar '18

So this one had me puzzled for rather a while. We all know about the bootstrap event ‘shown.bs.modal’ that fires when a modal has been loaded. However, when the modal content is loaded via AJAX, I’ve found that can still be triggered a little bit in advance of contained elements loading in the DOM.

To give a concrete example, I encountered this when trying to activate datatables on a table that I was embedding in a modal. My script was set up as follows:

$('.modal').on('shown.bs.modal', function (e) {
$('.table-class').DataTable({
//Datatable options
});
});

This tended to work about 50% of the time, and after a lot of thought I realised that the times it didn’t run were due to the table element not being loaded into the DOM before the DataTable call is made. Even though the Bootstrap event had been fired, the DOM was yet to catch up.

Now there are various ways around this, most obviously by using ‘setTimeout’ to add a short delay before triggering subsequent logic, although this technique has always struck me as rather imprecise and risky. Fortunately, jQuery provides the ‘ready’ function which gives us all we need to make this logic work perfectly:

$('.modal').on('shown.bs.modal', function (e) {
$('.table-class').ready(function() {
$('.table-class').DataTable({
//Datatable options
});
});
});

All we are doing here is adding a subsequent observer to the element so that we can be sure the DOM is aware of it before we try to run any further logic. Simple as that!

12
Mar '18

Bit of a follow-on here from my post on record versioning. Versioning a record is all well and good, but often you would like to version the reccord’s relations too in order to make the record meaningful, provide context, provide metadata etc.

In the code below, the archive function on the parent model is triggered to create the archive (versioned) record. Note that I have added the with(‘notes’) call, which will add all related records from the ‘notes’ relation into the resulting array. As such this relation has been serialiasied with the parent record.

When the archive (versioned) record is deserialised we will then find that the ‘notes’ are attached to the copy of the parent model, but as simple arrays rather than objects. The custom ‘hydrateArchive’ function simply takes these arrays and turns them back into real models.

Parent Model

/**
* Archive
* @return \App\Model\Archive
*/
public function archive() {
return $this->archives()->create([
'data' => serialize($this->with('notes')->find($this->id)->toArray())
]);
}
/**
* Custom archive hydrate
*
* @return \App\Model\Base
*/
public function hydrateArchive() {
if(!$this->notes)
return $this;
$this->notes = collect($this->notes)->map(function ($data) {
return new \App\Model\Note($data);
});
return $this;
}

Archive Record

/**
* Deserialise
* @return \App\Model\Base
*/
public function deserialise() {
$deserialised = with(new $this->parent_type)->newFromBuilder(unserialize($this->data));
return $deserialised->hydrateArchive();
}
05
Feb '18

So we all know about Laravel’s built-in ‘creating’, ‘created’, ‘updating’, ‘updated’ etc model events. Seriously useful events for all manner of purposes.

Recently I found myself needing to add a couple more; one to trigger when a model was loaded (for logging purposes), and one before a model was updated (so that I could archive a copy of it before the data was changed).

I came up with the following code and inserted it into an abstract base model class, which all the other models extend.

protected $observables = ['loaded', 'beforeUpdate'];
/**
* Register a loaded model event with the dispatcher.
*
* @param  \Closure|string  $callback
* @return void
*/
public static function loaded($callback)
{
static::registerModelEvent('loaded', $callback);
}
/**
* Register a before update model event with the dispatcher.
*
* @param  \Closure|string  $callback
* @return void
*/
public static function beforeUpdate($callback)
{
static::registerModelEvent('beforeUpdate', $callback);
}
/**
* Create a new model instance.
*
* @param  array  $attributes
* @return \Illuminate\Database\Eloquent\Model|static
*/
public function newFromBuilder($attributes = array(), $connection = null)
{
$instance = parent::newFromBuilder($attributes);
$instance->fireModelEvent('loaded', false);
return $instance;
}
/**
* Trigger before update
*
* @param  array  $attributes
* @return \Illuminate\Database\Eloquent\Model|static
*/
public function update(array $attributes = [], array $options = [])
{
$this->fireModelEvent('beforeUpdate', false);
return parent::update($attributes);
}
02
Jan '18

I’ve tried various different mechanisms for versioning records over the years, but recently I’ve been tasked with creating a versioning solution that is unobtrusive, will bolt-on for an existing Laravel site, and which doesn’t require any structural changes to existing tables.

The way I decided to approach this was via an ‘Archive’ table (with associated model) with a polymorphic relation to the parent record, whatever it be, and a trait that could be applied to any other models and would automatically create a versioned copy on of the parent whenever it was saved. Broadly speaking it looks like this:

Migration

Schema::create('archives', function (Blueprint $table) {
$table->increments('id');
$table->integer('parent_id')->unsigned()->index();
$table->string('parent_type');
$table->longText('data');
$table->timestamps();
$table->index(['parent_id', 'parent_type']);
});

Model

class Archive extends \Eloquent {
protected $fillable = ['parent_id', 'parent_type', 'data'];
/**
* Parent relationship
*/
public function parent() {
return $this->morphTo();
}
/**
* Deserialise / hydrate
* @return \Eloquent
*/
public function deserialise() {
$deserialised = new with($this->parent_type);
$deserialised->fill(unserialize($this->data));
return $deserialised;
}
}

In practice I would usually also store additional meta-data in the archive record, relating to the user that did the save, and any contextual information. Of course we’d want timestamps here too.

Trait

trait Archivable
{
/**
* Custom boot method
*/
public static function bootArchivable()
{
/*
* Trigger on update (nothing to archive on initial create)
*/
static::updating(function ($record) {
$record->archive();
});
/*
* Trigger on delete
*/
static::deleting(function ($record) {
$record->clearArchives();
});
}
/**
* Archive relationship
*/
public function archives() {
return $this->morphMany('\App\Model\Archive', 'parent')->orderBy('id', 'desc');
}
/**
* Clear all archives
*/
public function clearArchives() {
$this->archives()->delete();
}
/**
* Archive
* @return \App\Model\Archive
*/
public function archive() {
return $this->archives()->create([
'data' => serialize($this->getOriginal())
]);
}
/**
* Get previous version
* @return \Eloquent
*/
public function previousVersion() {
if($archive = $this->archives->first()) {
return $archive->deserialise();
}
}
/**
* Get all archives hydrated
* @return Collection
*/
public function allArchives() {
return $this->archives->map(function ($archive) {
return $archive->deserialise();
});
}
}

So the entire parent record is serialised into the ‘data’ field of a new ‘Archive’ record each time the parent is updated. I’ve shown example accessors for previous version(s) with a deserialise/hydrate function to recreate the parent record from an archive.

14
Nov '17

I always make security my top priority in any application I build. This is fine when I build something from scratch, but when I inherit a site I often encounter some interesting challenges. In this instance I was building a new application to sit on an existing database, which was in pretty decent state other than the fact that all user records had MD5 passwords!
I couldn’t force all users to go through a password reset process, and I wasn’t going to start trying to crack all the passwords (yes, yes, I know that could have been done but it’s too black-hat for my taste), so I had to think of a mechanism to convert the passwords transparently to the users.
I came up with a system that overrides Laravel’s standard login function, within the Illuminate\Foundation\Auth\AuthenticatesUsers class to do the following:

  • Find the user being logged in by their email address
  • Check if the user record has been flagged as ‘safe’ (this is just an additional boolean column on the record)
  • If not it compares the user record’s password with an MD5 hash of the submitted password
  • If the MD5 hash matches then it produces a new secure hash (bcrypt is currently the Laravel standard) of the submitted password, stores it on the user record and flips the ‘safe’ flag
  • Then the main Laravel login function is called, which takes it all from there
use AuthenticatesUsers {
login as coreLogin;
}
/**
* Handle a login request to the application.
*
* @param  \Illuminate\Http\Request $request
* @return \Illuminate\Http\Response
*/
public function login(Request $request)
{
$credentials = $this->getCredentials($request);
if(!empty($credentials['email']) && !empty($credentials['password'])) {
if($user = \App\Model\User::where('email', $credentials['email'])->where('active', true)->first()) {
if(!$user->safe) {
if($user->password == md5(trim($credentials['password']))) {
$user->password = \Hash::make(trim($credentials['password']));
$user->safe = true;
$user->save();
}
}
}
}
return $this->coreLogin($request);
}

And there we have it. Anytime a user with an old password logs in they will have it transparently updated and secured.

21
Oct '17

Cloning simple markup is usually a fairly trivial task in jQuery, using the .clone() function, however it becomes a major headache when there are form elements involved. jQuery’s clone function effectively works based on the raw HTML of the page and as such any changes that have since taken place within the DOM are ignored. This doesn’t sound like such a big deal until you realise that includes changes to all form input elements; the clone will have these all reset to their initial values.

I’ve written a little function to get round this issue, which simply ‘fixes’ the current values fo all input fields (except files) in the markup, allowing them to be cloned correctly:

function fixValues(element) {
element.find('input[type=text]').each(function() {
$(this).attr('value', $(this).val());
});
element.find('input[type=checkbox], input[type=radio]').each(function() {
$(this).attr('checked', $(this).is(':checked') ? 'checked' : '');
});
element.find('select option:selected').each(function() {
$(this).attr('selected', 'selected');
});
element.find('textarea').each(function() {
$(this).html($(this).val());
});
}

Just trigger this function on the element you want to clone, immediately before calling the jQuery clone function (or, if you’re feeling really enthusiastic, you could even extend the clone function itself) and your values should all be copied over as expected.